Nov 06 18:27:26 devstack cinder-volume[75699]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 18:27:26 devstack cinder-volume[75699]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 18:27:26 devstack cinder-volume[75699]: we strongly recommend against using it for new projects. Nov 06 18:27:26 devstack cinder-volume[75699]: If you are already using Eventlet, we recommend migrating to a different Nov 06 18:27:26 devstack cinder-volume[75699]: framework. For more detail see Nov 06 18:27:26 devstack cinder-volume[75699]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 18:27:26 devstack cinder-volume[75699]: import eventlet # noqa Nov 06 18:27:29 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 18:27:29 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 18:27:29 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 18:27:30 devstack cinder-volume[75699]: INFO dbcounter [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Registered counter for database cinder Nov 06 18:27:30 devstack cinder-volume[75699]: DEBUG oslo_db.sqlalchemy.engines [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 18:27:30 devstack cinder-volume[75699]: DEBUG dbcounter [-] [75699] Writer thread running {{(pid=75699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 18:27:30 devstack cinder-volume[75699]: INFO cinder.rpc [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 18:27:30 devstack cinder-volume[75699]: INFO cinder.rpc [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 18:27:30 devstack cinder-volume[75699]: DEBUG oslo_db.sqlalchemy.engines [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 18:27:30 devstack cinder-volume[75699]: INFO cinder.volume.manager [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Determined volume DB was empty at startup. Nov 06 18:27:30 devstack cinder-volume[75699]: DEBUG cinder.volume.manager [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75699) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 18:27:30 devstack cinder-volume[75699]: INFO cinder.volume.manager [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 18:27:30 devstack cinder-volume[75699]: WARNING stevedore.named [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 18:27:30 devstack cinder-volume[75699]: WARNING castellan.key_manager [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 18:27:30 devstack cinder-volume[75699]: WARNING cinder.keymgr.conf_key_mgr [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 18:27:30 devstack cinder-volume[75699]: DEBUG cinder.volume.drivers.lvm [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75699) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 06 18:27:30 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] CMD "cinder-rtstool verify" returned: 0 in 0.505s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_db.sqlalchemy.engines [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 18:27:31 devstack cinder-volume[75699]: INFO cinder.rpc [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 06 18:27:31 devstack cinder-volume[75699]: INFO cinder.rpc [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 06 18:27:31 devstack cinder-volume[75699]: WARNING stevedore.named [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 18:27:31 devstack cinder-volume[75699]: WARNING castellan.key_manager [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 18:27:31 devstack cinder-volume[75699]: INFO cinder.volume.manager [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_db.sqlalchemy.engines [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 18:27:31 devstack cinder-volume[75699]: INFO oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Starting 1 workers Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Started child 75889 {{(pid=75699) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Full set of CONF: {{(pid=75699) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] ******************************************************************************** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Configuration options gathered from: {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] ================================================================================ {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] allow_availability_zone_fallback = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] allow_compression_on_image_upload = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] allowed_direct_url_schemes = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] api_rate_limit = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] auth_strategy = keystone {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75889]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] az_cache_duration = 3600 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_availability_zone = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_host = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_stats_polling_interval = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backup_api_class = cinder.backup.api.API {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backup_name_template = backup-%s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backup_use_same_host = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backup_use_temp_snapshot = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] chap_password = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] chap_username = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cinder_internal_tenant_project_id = fbe803b2b9ff4026a2313eabe7a56418 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cinder_internal_tenant_user_id = 8509ac13e1834eb2921883a2dda8fda2 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cloned_volume_same_az = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cluster = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] compression_format = gzip {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] compute_api_class = cinder.compute.nova.API {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] config_dir = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] config_source = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] control_exchange = openstack {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] debug = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] default_availability_zone = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] default_group_type = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] default_volume_type = lvmdriver-1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] disk_geometry = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] driver_client_cert = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] driver_client_cert_key = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] driver_data_namespace = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] driver_ssl_cert_path = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] driver_ssl_cert_verify = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] driver_use_ssl = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] enable_force_upload = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] enable_new_services = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] enable_unsupported_driver = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] enforce_multipath_for_image_xfer = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] filter_function = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance_api_insecure = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance_api_servers = ['http://192.168.122.68/image'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance_api_ssl_compression = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance_ca_certificates_file = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance_catalog_info = image:glance:publicURL {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance_certfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance_keyfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance_num_retries = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance_preferred_stores = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance_request_timeout = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] goodness_function = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] graceful_shutdown_timeout = 5 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] group_api_class = cinder.group.api.API {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] host = devstack {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] image_compress_on_upload = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] image_conversion_address_space_limit = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] image_conversion_cpu_limit = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] image_conversion_disable = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] image_introspection_address_space_limit = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] image_introspection_cpu_limit = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] image_upload_use_cinder_backend = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] image_upload_use_internal_tenant = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] image_volume_cache_enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] image_volume_cache_max_count = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] image_volume_cache_max_size_gb = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] init_host_max_objects_retrieval = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] instance_format = [instance: %(uuid)s] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] iscsi_target_flags = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] iscsi_write_cache = on {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] iser_helper = tgtadm {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] iser_ip_address = 192.168.122.68 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] iser_port = 3260 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] log_color = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] log_config_append = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] log_dir = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] log_file = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] log_options = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] log_rotate_interval = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] log_rotate_interval_type = days {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] log_rotation_type = none {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] max_age = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] max_logfile_count = 30 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] max_logfile_size_mb = 200 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] max_over_subscription_ratio = 20.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] message_reap_interval = 86400 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] message_ttl = 2592000 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] migration_create_volume_timeout_secs = 300 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] monkey_patch = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] monkey_patch_modules = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] my_ip = 192.168.122.68 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] no_snapshot_gb_quota = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] num_iser_scan_tries = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] num_shell_tries = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] num_volume_device_scan_tries = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] nvmeof_conn_info_version = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] nvmet_ns_id = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] nvmet_port_id = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] osapi_max_limit = 1000 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] osapi_volume_ext_list = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] osapi_volume_listen_port = 8776 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] osapi_volume_use_ssl = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] osapi_volume_workers = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] per_volume_size_limit = -1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] periodic_fuzzy_delay = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] periodic_interval = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] public_endpoint = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] publish_errors = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] quota_backup_gigabytes = 1000 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] quota_backups = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] quota_gigabytes = 1000 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] quota_groups = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] quota_snapshots = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] quota_volumes = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] rate_limit_burst = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] rate_limit_except_level = CRITICAL {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] rate_limit_interval = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] reinit_driver_count = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] replication_device = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] report_discard_supported = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] report_interval = 120 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] reservation_clean_interval = 86400 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] reservation_expire = 86400 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] reserved_image_namespaces = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] reserved_percentage = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] rpc_response_timeout = 120 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] run_external_periodic_tasks = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] scst_target_driver = iscsi {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] scst_target_iqn_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] service_down_time = 720 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] shell_completion = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] snapshot_name_template = snapshot-%s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] snapshot_same_host = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] split_loggers = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] state_path = /opt/stack/data/cinder {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] storage_availability_zone = nova {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] storage_protocol = iSCSI {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] syslog_log_facility = LOG_USER {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] target_helper = lioadm {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] target_ip_address = 192.168.122.68 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] target_port = 3260 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] target_protocol = iscsi {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] target_secondary_ip_addresses = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] trace_flags = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] transport_url = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] until_refresh = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] use_chap_auth = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] use_default_quota_class = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] use_journal = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] use_json = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] use_multipath_for_image_xfer = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] use_stderr = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] use_syslog = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] verify_glance_signatures = enabled {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] volume_api_class = cinder.volume.api.API {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] volume_backend_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] volume_clear = zero {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] volume_clear_ionice = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] volume_clear_size = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] volume_copy_bps_limit = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] volume_dd_blocksize = 1M {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75889]: INFO cinder.volume.manager [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] volume_name_template = volume-%s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] volume_service_inithost_offload = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] volume_usage_audit_period = month {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] zoning_mode = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_concurrency.disable_process_locking = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.auth_section = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.auth_type = password {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.auth_version = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.cache = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.certfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.include_service_catalog = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.insecure = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.interface = public {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.keyfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.memcache_password = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.memcache_username = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.region_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.service_type = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.68/identity {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.backend = dogpile.cache.null {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.backend_argument = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.backend_expiration_time = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.config_prefix = cache.oslo {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.debug_cache_backend = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.enable_retry_client = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.enable_socket_keepalive = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.expiration_time = 600 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.hashclient_retry_attempts = 2 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.memcache_dead_retry = 300 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.memcache_pool_maxsize = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.memcache_sasl_enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.password = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.proxies = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.redis_db = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.redis_server = localhost:6379 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.retry_attempts = 2 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.retry_delay = 0.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.socket_keepalive_count = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.socket_keepalive_idle = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.socket_keepalive_interval = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.socket_timeout = 1.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.tls_allowed_ciphers = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.tls_cafile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.tls_certfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.tls_enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.tls_keyfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cache.username = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] coordination.backend_url = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.asyncio_connection = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.asyncio_slave_connection = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.backend = sqlalchemy {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.connection = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.connection_debug = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.connection_parameters = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.connection_recycle_time = 3600 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.connection_trace = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.db_inc_retry_interval = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.db_max_retries = 20 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.db_max_retry_interval = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.db_retry_interval = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.max_overflow = 50 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.max_pool_size = 5 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.max_retries = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.mysql_wsrep_sync_wait = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.pool_timeout = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.retry_interval = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.slave_connection = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.sqlite_synchronous = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.synchronous_reader = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] database.use_db_reconnect = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_tracing.insecure = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:31 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] profiler.connection_string = messaging:// {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] profiler.enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] profiler.es_doc_type = notification {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] profiler.es_scroll_size = 10000 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] profiler.es_scroll_time = 2m {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] profiler.filter_error_trace = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] profiler.hmac_keys = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] profiler.sentinel_service_name = mymaster {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] profiler.socket_timeout = 0.1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] profiler.trace_requests = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] profiler.trace_sqlalchemy = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] profiler_jaeger.process_tags = {} {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] profiler_jaeger.service_name_prefix = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] profiler_otlp.service_name_prefix = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_policy.enforce_new_defaults = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_policy.policy_default_rule = default {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_policy.policy_file = policy.yaml {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack sudo[75893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 06 18:27:31 devstack sudo[75893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] privsep_osbrick.group = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] privsep_osbrick.helper_command = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] privsep_osbrick.user = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cinder_sys_admin.group = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cinder_sys_admin.helper_command = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] cinder_sys_admin.user = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] service_user.auth_section = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] service_user.auth_type = password {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] service_user.cafile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] service_user.certfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] service_user.collect_timing = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] service_user.insecure = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] service_user.keyfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] service_user.send_service_user_token = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] service_user.split_loggers = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] service_user.timeout = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] service_user.tls_ciphers = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] service_user.tls_min_version = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance.auth_section = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance.auth_type = password {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance.certfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance.collect_timing = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance.insecure = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance.keyfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance.region_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance.split_loggers = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance.timeout = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance.tls_ciphers = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] glance.tls_min_version = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.backend_availability_zone = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.chap_password = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.chap_username = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.disk_geometry = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.driver_client_cert = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.driver_client_cert_key = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.driver_data_namespace = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.driver_use_ssl = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.extra_capabilities = {} {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.filter_function = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.goodness_function = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.iscsi_target_flags = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.iscsi_write_cache = on {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.iser_helper = tgtadm {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.iser_ip_address = 192.168.122.68 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.iser_port = 3260 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.lvm_share_target = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.lvm_type = auto {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.num_shell_tries = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.replication_device = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.report_discard_supported = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.reserved_percentage = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.target_helper = tgtadm {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.target_ip_address = 192.168.122.68 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.target_port = 3260 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.target_protocol = iscsi {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.trace_flags = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.unique_fqdn_network = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.use_chap_auth = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.volume_backend_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.volume_clear = zero {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.volume_clear_ionice = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.volume_clear_size = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_reports.file_event_handler = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_reports.log_dir = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.backend_host = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.chap_password = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.chap_username = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.disk_geometry = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.driver_client_cert = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.extra_capabilities = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.filter_function = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.goodness_function = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.iser_helper = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.iser_ip_address = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.iser_port = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.lvm_share_target = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.lvm_type = auto {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.num_shell_tries = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.replication_device = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.report_discard_supported = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.reserved_percentage = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.scst_target_driver = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.storage_protocol = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.target_helper = lioadm {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.target_ip_address = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.target_port = 3260 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.trace_flags = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.use_chap_auth = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.volume_clear = zero {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.volume_clear_size = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] lvmdriver-1.volumes_dir = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.ssl = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_notifications.driver = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_notifications.retry = -1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] key_manager.fixed_key = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican.barbican_api_version = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican.barbican_endpoint = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican.barbican_endpoint_type = public {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican.barbican_region_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican.cafile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican.certfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican.collect_timing = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican.insecure = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican.keyfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican.number_of_retries = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican.retry_delay = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican.send_service_user_token = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican.split_loggers = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican.timeout = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican.tls_ciphers = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican.tls_min_version = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican.verify_ssl = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican.verify_ssl_path = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican_service_user.auth_section = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican_service_user.auth_type = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican_service_user.cafile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican_service_user.certfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican_service_user.collect_timing = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican_service_user.insecure = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican_service_user.keyfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican_service_user.split_loggers = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican_service_user.timeout = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican_service_user.tls_ciphers = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] barbican_service_user.tls_min_version = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] vault.approle_role_id = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] vault.approle_secret_id = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] vault.auth_method = approle {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] vault.auth_path = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] vault.kv_mountpoint = secret {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] vault.kv_path = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] vault.kv_version = 2 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] vault.namespace = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] vault.root_token_id = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] vault.ssl_ca_crt_file = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] vault.timeout = 60.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] vault.token_file = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] vault.token_role = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] vault.use_ssl = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:27:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] ******************************************************************************** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 18:27:31 devstack sudo[75893]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:31 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:31 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:31 devstack sudo[75947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 18:27:31 devstack sudo[75947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:32 devstack sudo[75947]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:32 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.336s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:32 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:27:32 devstack cinder-volume[75889]: INFO cinder.brick.local_dev.lvm [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 06 18:27:32 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:32 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:32 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:32 devstack sudo[76094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 18:27:32 devstack sudo[76094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:32 devstack sudo[76094]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:32 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:32 devstack cinder-volume[75889]: DEBUG cinder.brick.local_dev.lvm [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75889) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 06 18:27:32 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:32 devstack sudo[76187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 18:27:32 devstack sudo[76187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:33 devstack sudo[76187]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:33 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.490s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:33 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:33 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:33 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:33 devstack sudo[76387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 18:27:33 devstack sudo[76387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:33 devstack sudo[76387]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:33 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.319s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:33 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:33 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:33 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:33 devstack sudo[76507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 06 18:27:33 devstack sudo[76507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:33 devstack sudo[76507]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:33 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.266s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:33 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:33 devstack sudo[76511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 18:27:33 devstack sudo[76511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:34 devstack sudo[76511]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:34 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:34 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:34 devstack sudo[76596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 18:27:34 devstack sudo[76596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:34 devstack sudo[76596]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:34 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:34 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:34 devstack sudo[76599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 18:27:34 devstack sudo[76599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:34 devstack sudo[76599]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:34 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.366s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:34 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:34 devstack sudo[76676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 18:27:34 devstack sudo[76676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:34 devstack sudo[76676]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:35 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.363s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:35 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:35 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:35 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:35 devstack sudo[76710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 18:27:35 devstack sudo[76710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:35 devstack sudo[76710]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:35 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.329s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:35 devstack cinder-volume[75889]: INFO cinder.volume.drivers.lvm [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 06 18:27:35 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:35 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:35 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:35 devstack sudo[76716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 18:27:35 devstack sudo[76716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:35 devstack sudo[76716]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:35 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.321s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:35 devstack cinder-volume[75889]: DEBUG cinder.volume.drivers.lvm [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Updating volume stats {{(pid=75889) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 18:27:35 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:35 devstack sudo[76736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 18:27:35 devstack sudo[76736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:35 devstack sudo[76736]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:36 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:36 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:36 devstack sudo[76739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 18:27:36 devstack sudo[76739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:36 devstack sudo[76739]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:36 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:36 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:36 devstack sudo[76742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 18:27:36 devstack sudo[76742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:36 devstack sudo[76742]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:36 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:36 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:36 devstack sudo[76745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 18:27:36 devstack sudo[76745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:36 devstack sudo[76745]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:36 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:36 devstack cinder-volume[75889]: INFO cinder.volume.driver [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Driver hasn't implemented _init_vendor_properties() Nov 06 18:27:36 devstack cinder-volume[75889]: DEBUG cinder.volume.driver [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75889) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 18:27:36 devstack cinder-volume[75889]: DEBUG oslo_db.sqlalchemy.engines [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75889) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 18:27:36 devstack cinder-volume[75889]: DEBUG dbcounter [-] [75889] Writer thread running {{(pid=75889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 18:27:36 devstack cinder-volume[75889]: DEBUG cinder.db.api [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Building query based on filter {{(pid=75889) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 06 18:27:36 devstack cinder-volume[75889]: DEBUG cinder.image.image_utils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75889) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1319}} Nov 06 18:27:36 devstack cinder-volume[75889]: INFO cinder.keymgr.migration [None req-c9e33087-cd73-439b-8a5f-8edd48ac4bc4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 18:27:36 devstack cinder-volume[75889]: DEBUG cinder.volume.drivers.lvm [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Updating volume stats {{(pid=75889) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 18:27:36 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:36 devstack sudo[76750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 18:27:36 devstack sudo[76750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:37 devstack sudo[76750]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:37 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:37 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:37 devstack sudo[76754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 18:27:37 devstack sudo[76754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:37 devstack sudo[76754]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:37 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:37 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:37 devstack sudo[76758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 18:27:37 devstack sudo[76758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:37 devstack sudo[76758]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:37 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:37 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:37 devstack sudo[76761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 18:27:37 devstack sudo[76761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:38 devstack sudo[76761]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:38 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:38 devstack cinder-volume[75889]: DEBUG cinder.manager [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Notifying Schedulers of capabilities ... {{(pid=75889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:27:38 devstack cinder-volume[75889]: INFO cinder.volume.manager [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Driver initialization completed successfully. Nov 06 18:27:38 devstack cinder-volume[75889]: INFO cinder.manager [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Initiating service 2 cleanup Nov 06 18:27:38 devstack cinder-volume[75889]: INFO cinder.manager [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Service 2 cleanup completed. Nov 06 18:27:38 devstack cinder-volume[75889]: DEBUG cinder.service [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Creating RPC server for service cinder-volume {{(pid=75889) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 18:27:38 devstack cinder-volume[75889]: DEBUG cinder.service [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75889) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 18:27:38 devstack cinder-volume[75889]: INFO cinder.volume.manager [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 06 18:27:38 devstack cinder-volume[75889]: DEBUG cinder.volume.drivers.lvm [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Updating volume stats {{(pid=75889) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 18:27:38 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:38 devstack sudo[76765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 18:27:38 devstack sudo[76765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:38 devstack sudo[76765]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:38 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:38 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:38 devstack sudo[76769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 18:27:38 devstack sudo[76769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:38 devstack sudo[76769]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:38 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:38 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:38 devstack sudo[76775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 18:27:38 devstack sudo[76775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:39 devstack sudo[76775]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:39 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:39 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:27:39 devstack sudo[76778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 18:27:39 devstack sudo[76778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:27:39 devstack sudo[76778]: pam_unix(sudo:session): session closed for user root Nov 06 18:27:39 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:27:39 devstack cinder-volume[75889]: INFO cinder.volume.manager [None req-610f74da-6b48-4089-9aac-3ea3a8b6df0a None None] Driver post RPC initialization completed successfully. Nov 06 18:27:41 devstack cinder-volume[75699]: DEBUG dbcounter [-] [75699] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:27:49 devstack cinder-volume[75889]: DEBUG dbcounter [-] [75889] Writing DB stats cinder:SELECT=2 {{(pid=75889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:27:49 devstack cinder-volume[75889]: DEBUG dbcounter [-] [75889] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:28:08 devstack cinder-volume[75889]: DEBUG oslo_service.periodic_task [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Running periodic task VolumeManager._thread_info {{(pid=75889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:28:08 devstack cinder-volume[75889]: DEBUG cinder.volume.manager [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] thread count: 6 {{(pid=75889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:28:08 devstack cinder-volume[75889]: DEBUG cinder.volume.manager [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] thread info: [<_MainThread(MainThread, started 134285180838016)>, , , , , ] {{(pid=75889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:29:08 devstack cinder-volume[75889]: DEBUG oslo_service.periodic_task [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:29:08 devstack cinder-volume[75889]: DEBUG cinder.volume.drivers.lvm [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Updating volume stats {{(pid=75889) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 18:29:08 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:29:08 devstack sudo[81832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 18:29:08 devstack sudo[81832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:29:08 devstack sudo[81832]: pam_unix(sudo:session): session closed for user root Nov 06 18:29:08 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:29:08 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:29:08 devstack sudo[81835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 18:29:08 devstack sudo[81835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:29:08 devstack sudo[81835]: pam_unix(sudo:session): session closed for user root Nov 06 18:29:08 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:29:08 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:29:08 devstack sudo[81838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 18:29:08 devstack sudo[81838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:29:09 devstack sudo[81838]: pam_unix(sudo:session): session closed for user root Nov 06 18:29:09 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:29:09 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:29:09 devstack sudo[81841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 18:29:09 devstack sudo[81841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:29:09 devstack sudo[81841]: pam_unix(sudo:session): session closed for user root Nov 06 18:29:09 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:29:09 devstack cinder-volume[75889]: DEBUG cinder.manager [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Notifying Schedulers of capabilities ... {{(pid=75889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:29:09 devstack cinder-volume[75889]: DEBUG oslo_service.periodic_task [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Running periodic task VolumeManager._thread_info {{(pid=75889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:29:09 devstack cinder-volume[75889]: DEBUG cinder.volume.manager [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] thread count: 6 {{(pid=75889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:29:09 devstack cinder-volume[75889]: DEBUG cinder.volume.manager [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] thread info: [<_MainThread(MainThread, started 134285180838016)>, , , , , ] {{(pid=75889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:29:49 devstack cinder-volume[75889]: DEBUG dbcounter [-] [75889] Writing DB stats cinder:SELECT=1 {{(pid=75889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:29:49 devstack cinder-volume[75889]: DEBUG dbcounter [-] [75889] Writing DB stats cinder:UPDATE=1 {{(pid=75889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:30:08 devstack cinder-volume[75889]: DEBUG oslo_service.periodic_task [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:30:08 devstack cinder-volume[75889]: DEBUG cinder.volume.drivers.lvm [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Updating volume stats {{(pid=75889) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 18:30:08 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:30:08 devstack sudo[83397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 18:30:08 devstack sudo[83397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:30:08 devstack sudo[83397]: pam_unix(sudo:session): session closed for user root Nov 06 18:30:08 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:30:08 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:30:08 devstack sudo[83405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 18:30:08 devstack sudo[83405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:30:08 devstack sudo[83405]: pam_unix(sudo:session): session closed for user root Nov 06 18:30:08 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:30:08 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:30:08 devstack sudo[83410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 18:30:08 devstack sudo[83410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:30:09 devstack sudo[83410]: pam_unix(sudo:session): session closed for user root Nov 06 18:30:09 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:30:09 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:30:09 devstack sudo[83413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 18:30:09 devstack sudo[83413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:30:09 devstack sudo[83413]: pam_unix(sudo:session): session closed for user root Nov 06 18:30:09 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:30:09 devstack cinder-volume[75889]: DEBUG cinder.manager [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Notifying Schedulers of capabilities ... {{(pid=75889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:30:09 devstack cinder-volume[75889]: DEBUG oslo_service.periodic_task [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Running periodic task VolumeManager._thread_info {{(pid=75889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:30:09 devstack cinder-volume[75889]: DEBUG cinder.volume.manager [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] thread count: 6 {{(pid=75889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:30:09 devstack cinder-volume[75889]: DEBUG cinder.volume.manager [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] thread info: [<_MainThread(MainThread, started 134285180838016)>, , , , , ] {{(pid=75889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:31:08 devstack cinder-volume[75889]: DEBUG oslo_service.periodic_task [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:31:08 devstack cinder-volume[75889]: DEBUG cinder.volume.drivers.lvm [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Updating volume stats {{(pid=75889) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 18:31:08 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:31:08 devstack sudo[84889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 18:31:08 devstack sudo[84889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:31:08 devstack sudo[84889]: pam_unix(sudo:session): session closed for user root Nov 06 18:31:08 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:31:08 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:31:08 devstack sudo[84893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 18:31:08 devstack sudo[84893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:31:08 devstack sudo[84893]: pam_unix(sudo:session): session closed for user root Nov 06 18:31:08 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:31:08 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:31:08 devstack sudo[84898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 18:31:08 devstack sudo[84898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:31:09 devstack sudo[84898]: pam_unix(sudo:session): session closed for user root Nov 06 18:31:09 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.241s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:31:09 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:31:09 devstack sudo[84903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 18:31:09 devstack sudo[84903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:31:09 devstack sudo[84903]: pam_unix(sudo:session): session closed for user root Nov 06 18:31:09 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:31:09 devstack cinder-volume[75889]: DEBUG cinder.manager [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Notifying Schedulers of capabilities ... {{(pid=75889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:31:09 devstack cinder-volume[75889]: DEBUG oslo_service.periodic_task [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] Running periodic task VolumeManager._thread_info {{(pid=75889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:31:09 devstack cinder-volume[75889]: DEBUG cinder.volume.manager [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] thread count: 6 {{(pid=75889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:31:09 devstack cinder-volume[75889]: DEBUG cinder.volume.manager [None req-d19389d6-fa83-4899-94fe-655cac397334 None None] thread info: [<_MainThread(MainThread, started 134285180838016)>, , , , , ] {{(pid=75889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:31:49 devstack cinder-volume[75889]: DEBUG dbcounter [-] [75889] Writing DB stats cinder:SELECT=1 {{(pid=75889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:31:49 devstack cinder-volume[75889]: DEBUG dbcounter [-] [75889] Writing DB stats cinder:UPDATE=1 {{(pid=75889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:31:56 devstack cinder-volume[75699]: INFO oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Caught SIGTERM, stopping children Nov 06 18:31:56 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Acquiring lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 18:31:56 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Acquired lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 18:31:56 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Releasing lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 18:31:56 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Stop services. {{(pid=75699) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 18:31:56 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Killing children. {{(pid=75699) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 18:31:56 devstack cinder-volume[75699]: INFO oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Waiting on 1 children to exit Nov 06 18:31:58 devstack cinder-volume[75889]: DEBUG oslo_concurrency.lockutils [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Acquiring lock "singleton_lock" {{(pid=75889) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 18:31:58 devstack cinder-volume[75889]: DEBUG oslo_concurrency.lockutils [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Acquired lock "singleton_lock" {{(pid=75889) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 18:31:58 devstack cinder-volume[75889]: DEBUG oslo_concurrency.lockutils [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Releasing lock "singleton_lock" {{(pid=75889) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 18:31:58 devstack cinder-volume[75889]: WARNING amqp [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 18:31:58 devstack cinder-volume[75889]: WARNING amqp [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 18:31:58 devstack cinder-volume[75699]: INFO oslo_service.backend._eventlet.service [None req-8c7285f1-e68c-40a2-8355-a36618ac77c8 None None] Child 75889 exited with status 0 Nov 06 18:31:58 devstack cinder-volume[85970]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 18:31:58 devstack cinder-volume[85970]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 18:31:58 devstack cinder-volume[85970]: we strongly recommend against using it for new projects. Nov 06 18:31:58 devstack cinder-volume[85970]: If you are already using Eventlet, we recommend migrating to a different Nov 06 18:31:58 devstack cinder-volume[85970]: framework. For more detail see Nov 06 18:31:58 devstack cinder-volume[85970]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 18:31:58 devstack cinder-volume[85970]: import eventlet # noqa Nov 06 18:32:00 devstack cinder-volume[85970]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 18:32:00 devstack cinder-volume[85970]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 18:32:00 devstack cinder-volume[85970]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 18:32:01 devstack cinder-volume[85970]: INFO dbcounter [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Registered counter for database cinder Nov 06 18:32:01 devstack cinder-volume[85970]: DEBUG oslo_db.sqlalchemy.engines [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85970) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 18:32:01 devstack cinder-volume[85970]: DEBUG dbcounter [-] [85970] Writer thread running {{(pid=85970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 18:32:01 devstack cinder-volume[85970]: INFO cinder.rpc [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 18:32:01 devstack cinder-volume[85970]: INFO cinder.rpc [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 18:32:01 devstack cinder-volume[85970]: DEBUG oslo_db.sqlalchemy.engines [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85970) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 18:32:01 devstack cinder-volume[85970]: INFO cinder.volume.manager [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Determined volume DB was empty at startup. Nov 06 18:32:01 devstack cinder-volume[85970]: DEBUG cinder.volume.manager [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85970) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 18:32:01 devstack cinder-volume[85970]: INFO cinder.volume.manager [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 18:32:01 devstack cinder-volume[85970]: WARNING stevedore.named [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 18:32:01 devstack cinder-volume[85970]: WARNING castellan.key_manager [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 18:32:01 devstack cinder-volume[85970]: WARNING cinder.keymgr.conf_key_mgr [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 18:32:01 devstack cinder-volume[85970]: INFO cinder.volume.manager [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 18:32:01 devstack cinder-volume[85970]: DEBUG oslo_db.sqlalchemy.engines [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85970) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 18:32:02 devstack cinder-volume[85970]: INFO oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Starting 1 workers Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Started child 86187 {{(pid=85970) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Full set of CONF: {{(pid=85970) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] ******************************************************************************** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Configuration options gathered from: {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] ================================================================================ {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] allow_availability_zone_fallback = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] allow_compression_on_image_upload = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] allowed_direct_url_schemes = [] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] api_rate_limit = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] auth_strategy = keystone {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_availability_zone = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[86187]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_host = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_name = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_stats_polling_interval = 60 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backup_api_class = cinder.backup.api.API {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backup_name_template = backup-%s {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backup_use_same_host = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backup_use_temp_snapshot = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] chap_password = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] chap_username = {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cinder_internal_tenant_project_id = fbe803b2b9ff4026a2313eabe7a56418 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cinder_internal_tenant_user_id = 8509ac13e1834eb2921883a2dda8fda2 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cluster = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] compression_format = gzip {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] compute_api_class = cinder.compute.nova.API {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] config_dir = [] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] config_source = [] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] control_exchange = openstack {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] debug = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] default_availability_zone = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] default_group_type = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] default_volume_type = QuobyteHD {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] disk_geometry = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] driver_client_cert = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] driver_client_cert_key = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] driver_data_namespace = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] driver_ssl_cert_path = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] driver_ssl_cert_verify = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] driver_use_ssl = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] enable_new_services = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] enable_unsupported_driver = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] enabled_backends = ['QuobyteHD'] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] enforce_multipath_for_image_xfer = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] filter_function = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance_api_insecure = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance_api_servers = ['http://192.168.122.68/image'] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance_api_ssl_compression = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance_ca_certificates_file = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance_catalog_info = image:glance:publicURL {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance_certfile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance_keyfile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance_num_retries = 3 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance_preferred_stores = [] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance_request_timeout = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] goodness_function = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] graceful_shutdown_timeout = 5 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] group_api_class = cinder.group.api.API {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] host = devstack {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] image_compress_on_upload = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] image_conversion_address_space_limit = 1 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] image_conversion_cpu_limit = 60 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] image_conversion_disable = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] image_introspection_address_space_limit = 1 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] image_introspection_cpu_limit = 60 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] image_upload_use_cinder_backend = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] image_upload_use_internal_tenant = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] image_volume_cache_enabled = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] image_volume_cache_max_count = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] image_volume_cache_max_size_gb = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] init_host_max_objects_retrieval = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] instance_format = [instance: %(uuid)s] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] iscsi_target_flags = {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] iscsi_write_cache = on {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] iser_helper = tgtadm {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] iser_ip_address = 192.168.122.68 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] iser_port = 3260 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] log_color = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] log_config_append = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] log_dir = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] log_file = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] log_options = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] log_rotate_interval = 1 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] log_rotate_interval_type = days {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[86187]: INFO cinder.volume.manager [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 18:32:02 devstack cinder-volume[86187]: DEBUG cinder.volume.drivers.remotefs [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86187) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] log_rotation_type = none {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] max_age = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] max_logfile_count = 30 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] max_logfile_size_mb = 200 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] max_over_subscription_ratio = 20.0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] message_reap_interval = 86400 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] message_ttl = 2592000 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] migration_create_volume_timeout_secs = 300 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] monkey_patch = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] monkey_patch_modules = [] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] my_ip = 192.168.122.68 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] no_snapshot_gb_quota = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] num_iser_scan_tries = 3 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] num_shell_tries = 3 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] num_volume_device_scan_tries = 3 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] nvmeof_conn_info_version = 1 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] nvmet_ns_id = 10 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] nvmet_port_id = 1 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] osapi_max_limit = 1000 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] osapi_volume_ext_list = [] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] osapi_volume_listen = 0.0.0.0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] osapi_volume_listen_port = 8776 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] osapi_volume_use_ssl = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] osapi_volume_workers = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] per_volume_size_limit = -1 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] periodic_fuzzy_delay = 60 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] periodic_interval = 60 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] project_id_regex = [0-9a-f\-]+ {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] public_endpoint = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] publish_errors = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] quota_backup_gigabytes = 1000 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] quota_backups = 10 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] quota_gigabytes = 1000 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] quota_groups = 10 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] quota_snapshots = 10 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] quota_volumes = 10 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] rate_limit_burst = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] rate_limit_except_level = CRITICAL {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] rate_limit_interval = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] reinit_driver_count = 3 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] replication_device = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] report_discard_supported = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] report_interval = 120 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] reservation_clean_interval = 86400 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] reservation_expire = 86400 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] reserved_image_namespaces = [] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] reserved_percentage = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] rpc_response_timeout = 120 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] run_external_periodic_tasks = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] scst_target_driver = iscsi {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] scst_target_iqn_name = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] service_down_time = 720 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] shell_completion = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] snapshot_name_template = snapshot-%s {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] split_loggers = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] state_path = /opt/stack/data/cinder {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] storage_availability_zone = nova {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] storage_protocol = iSCSI {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] syslog_log_facility = LOG_USER {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] target_helper = lioadm {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] target_ip_address = 192.168.122.68 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] target_port = 3260 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] target_protocol = iscsi {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] target_secondary_ip_addresses = [] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] trace_flags = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] transfer_api_class = cinder.transfer.api.API {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] transport_url = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] until_refresh = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] use_chap_auth = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] use_default_quota_class = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] use_journal = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] use_json = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] use_multipath_for_image_xfer = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] use_stderr = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] use_syslog = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] verify_glance_signatures = enabled {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] volume_api_class = cinder.volume.api.API {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] volume_backend_name = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] volume_clear = zero {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] volume_clear_ionice = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] volume_clear_size = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] volume_copy_bps_limit = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] volume_dd_blocksize = 1M {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] volume_name_template = volume-%s {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] volume_service_inithost_offload = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] volume_usage_audit_period = month {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] zoning_mode = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_concurrency.disable_process_locking = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.auth_section = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.auth_type = password {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.auth_version = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.cache = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.certfile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.delay_auth_decision = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.http_connect_timeout = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.include_service_catalog = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.insecure = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.interface = public {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.keyfile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.memcache_password = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.memcache_username = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.region_name = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.service_token_roles_required = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.service_type = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.token_cache_time = 300 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.68/identity {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.backend = dogpile.cache.null {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.backend_argument = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.backend_expiration_time = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.config_prefix = cache.oslo {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.debug_cache_backend = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.enable_retry_client = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.enable_socket_keepalive = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.enabled = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.expiration_time = 600 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.hashclient_retry_attempts = 2 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.memcache_dead_retry = 300 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.memcache_pool_maxsize = 10 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.memcache_sasl_enabled = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.password = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[86187]: DEBUG cinder.volume.drivers.quobyte [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86187) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 18:32:02 devstack cinder-volume[86187]: WARNING cinder.volume.drivers.quobyte [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 18:32:02 devstack cinder-volume[86187]: WARNING cinder.volume.drivers.quobyte [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.proxies = [] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.redis_db = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.redis_sentinel_service_name = mymaster {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[86187]: DEBUG oslo_concurrency.processutils [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Running cmd (subprocess): mount.quobyte {{(pid=86187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.redis_server = localhost:6379 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.retry_attempts = 2 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.retry_delay = 0.0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.socket_keepalive_count = 1 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.socket_keepalive_idle = 1 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.socket_keepalive_interval = 1 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.socket_timeout = 1.0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.tls_allowed_ciphers = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.tls_cafile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.tls_certfile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.tls_enabled = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.tls_keyfile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cache.username = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] coordination.backend_url = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.asyncio_connection = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.asyncio_slave_connection = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.backend = sqlalchemy {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.connection = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.connection_debug = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.connection_parameters = {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.connection_recycle_time = 3600 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.connection_trace = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.db_inc_retry_interval = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.db_max_retries = 20 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.db_max_retry_interval = 10 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.db_retry_interval = 1 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.max_overflow = 50 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.max_pool_size = 5 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.max_retries = 10 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.mysql_wsrep_sync_wait = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.pool_timeout = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.retry_interval = 10 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.slave_connection = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.sqlite_synchronous = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.synchronous_reader = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] database.use_db_reconnect = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_tracing.insecure = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] profiler.connection_string = messaging:// {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] profiler.enabled = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] profiler.es_doc_type = notification {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] profiler.es_scroll_size = 10000 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] profiler.es_scroll_time = 2m {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] profiler.filter_error_trace = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] profiler.hmac_keys = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] profiler.sentinel_service_name = mymaster {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] profiler.socket_timeout = 0.1 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] profiler.trace_requests = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] profiler.trace_sqlalchemy = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] profiler_jaeger.process_tags = {} {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] profiler_jaeger.service_name_prefix = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] profiler_otlp.service_name_prefix = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_policy.enforce_new_defaults = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_policy.policy_default_rule = default {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_policy.policy_file = policy.yaml {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_policy.remote_timeout = 60.0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] privsep_osbrick.group = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] privsep_osbrick.helper_command = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] privsep_osbrick.user = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cinder_sys_admin.group = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cinder_sys_admin.helper_command = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] cinder_sys_admin.user = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] service_user.auth_section = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] service_user.auth_type = password {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] service_user.cafile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] service_user.certfile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] service_user.collect_timing = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] service_user.insecure = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] service_user.keyfile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] service_user.send_service_user_token = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] service_user.split_loggers = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] service_user.timeout = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] service_user.tls_ciphers = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] service_user.tls_min_version = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance.auth_section = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance.auth_type = password {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance.certfile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance.collect_timing = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance.insecure = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance.keyfile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance.region_name = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance.split_loggers = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance.timeout = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance.tls_ciphers = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] glance.tls_min_version = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.backend_availability_zone = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.chap_password = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.chap_username = {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.disk_geometry = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.driver_client_cert = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.driver_client_cert_key = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.driver_data_namespace = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.driver_use_ssl = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.enable_unsupported_driver = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.extra_capabilities = {} {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.filter_function = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.goodness_function = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.iscsi_target_flags = {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.iscsi_write_cache = on {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.iser_helper = tgtadm {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.iser_ip_address = 192.168.122.68 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.iser_port = 3260 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.nas_host = {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.nas_login = admin {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.nas_mount_options = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.nas_password = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.nas_private_key = {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.nas_share_path = {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.nas_ssh_port = 22 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[86187]: DEBUG oslo_concurrency.processutils [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] CMD "mount.quobyte" returned: 1 in 0.131s {{(pid=86187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86187) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.num_shell_tries = 3 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86187) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[86187]: DEBUG cinder.volume.drivers.quobyte [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86187) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.nvmet_port_id = 1 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.quobyte_client_cfg = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[86187]: INFO cinder.volume.drivers.quobyte [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 ... Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[86187]: DEBUG oslo_concurrency.processutils [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 -c /etc/quobyte/client-cinder.cfg {{(pid=86187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.quobyte_volume_url = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.replication_device = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.report_discard_supported = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.reserved_percentage = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.scst_target_driver = iscsi {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.scst_target_iqn_name = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.storage_protocol = iSCSI {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.target_helper = tgtadm {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.target_ip_address = 192.168.122.68 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.target_port = 3260 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.target_protocol = iscsi {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.trace_flags = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.unique_fqdn_network = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.use_chap_auth = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.volume_backend_name = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.volume_clear = zero {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.volume_clear_ionice = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.volume_clear_size = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_reports.file_event_handler = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack sudo[86193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 -c /etc/quobyte/client-cinder.cfg Nov 06 18:32:02 devstack sudo[86193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_reports.log_dir = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.backend_availability_zone = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.backend_host = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.chap_password = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.chap_username = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.chiscsi_conf = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.disk_geometry = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.driver_client_cert = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.driver_client_cert_key = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.driver_data_namespace = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.driver_use_ssl = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.extra_capabilities = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.filter_function = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.goodness_function = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.iscsi_target_flags = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.iscsi_write_cache = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.iser_helper = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.iser_ip_address = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.iser_port = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.iser_target_prefix = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.nas_host = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.nas_login = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.nas_mount_options = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.nas_password = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.nas_private_key = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.nas_share_path = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.nas_ssh_port = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.num_shell_tries = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.nvmet_ns_id = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.nvmet_port_id = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.replication_device = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.report_discard_supported = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.reserved_percentage = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.scst_target_driver = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.storage_protocol = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.target_helper = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.target_ip_address = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.target_port = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.target_prefix = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.target_protocol = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.trace_flags = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.unique_fqdn_network = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.use_chap_auth = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.volume_clear = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.volume_clear_ionice = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.volume_clear_size = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] QuobyteHD.volumes_dir = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.ssl = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.ssl_version = {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_notifications.driver = [] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_notifications.retry = -1 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] oslo_messaging_notifications.transport_url = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] key_manager.fixed_key = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican.barbican_api_version = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican.barbican_endpoint = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican.barbican_endpoint_type = public {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican.barbican_region_name = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican.cafile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican.certfile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican.collect_timing = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican.insecure = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican.keyfile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican.number_of_retries = 60 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican.retry_delay = 1 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican.send_service_user_token = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican.split_loggers = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican.timeout = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican.tls_ciphers = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican.tls_min_version = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican.verify_ssl = True {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican.verify_ssl_path = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican_service_user.auth_section = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican_service_user.auth_type = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican_service_user.cafile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican_service_user.certfile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican_service_user.collect_timing = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican_service_user.insecure = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican_service_user.keyfile = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican_service_user.split_loggers = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican_service_user.timeout = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican_service_user.tls_ciphers = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] barbican_service_user.tls_min_version = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] vault.approle_role_id = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] vault.approle_secret_id = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] vault.auth_method = approle {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] vault.auth_path = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] vault.kv_mountpoint = secret {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] vault.kv_path = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] vault.kv_version = 2 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] vault.namespace = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] vault.root_token_id = **** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] vault.ssl_ca_crt_file = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] vault.timeout = 60.0 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] vault.token_file = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] vault.token_role = None {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] vault.use_ssl = False {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:02 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] ******************************************************************************** {{(pid=85970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 18:32:02 devstack sudo[86193]: pam_unix(sudo:session): session closed for user root Nov 06 18:32:02 devstack cinder-volume[86187]: DEBUG oslo_concurrency.processutils [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.408s {{(pid=86187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:32:02 devstack cinder-volume[86187]: INFO cinder.volume.drivers.quobyte [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 succeeded Nov 06 18:32:02 devstack cinder-volume[86187]: DEBUG cinder.volume.drivers.quobyte [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86187) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:32:02 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.420s {{(pid=86187) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:32:02 devstack cinder-volume[86187]: DEBUG oslo_concurrency.processutils [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:32:02 devstack sudo[86295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:32:02 devstack sudo[86295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:32:02 devstack sudo[86295]: pam_unix(sudo:session): session closed for user root Nov 06 18:32:02 devstack cinder-volume[86187]: DEBUG oslo_concurrency.processutils [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.234s {{(pid=86187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:32:02 devstack cinder-volume[86187]: INFO cinder.volume.driver [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Driver hasn't implemented _init_vendor_properties() Nov 06 18:32:02 devstack cinder-volume[86187]: DEBUG cinder.volume.driver [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7579803466797, 'free_capacity_gb': 1773.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86187) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG oslo_db.sqlalchemy.engines [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86187) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG dbcounter [-] [86187] Writer thread running {{(pid=86187) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG cinder.db.api [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Building query based on filter {{(pid=86187) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG cinder.image.image_utils [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86187) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1319}} Nov 06 18:32:03 devstack cinder-volume[86187]: INFO cinder.keymgr.migration [None req-f79142ad-57f5-4226-8b82-abe6be6e156b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86187) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86187) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG cinder.volume.drivers.quobyte [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86187) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG cinder.volume.drivers.quobyte [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86187) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86187) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG oslo_concurrency.processutils [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:32:03 devstack sudo[86298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:32:03 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:32:03 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG oslo_concurrency.processutils [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.237s {{(pid=86187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG cinder.manager [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Notifying Schedulers of capabilities ... {{(pid=86187) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:32:03 devstack cinder-volume[86187]: INFO cinder.volume.manager [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Driver initialization completed successfully. Nov 06 18:32:03 devstack cinder-volume[86187]: INFO cinder.manager [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Initiating service 3 cleanup Nov 06 18:32:03 devstack cinder-volume[86187]: INFO cinder.manager [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Service 3 cleanup completed. Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG cinder.service [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Creating RPC server for service cinder-volume {{(pid=86187) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG cinder.service [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86187) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 18:32:03 devstack cinder-volume[86187]: INFO cinder.volume.manager [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86187) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86187) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG cinder.volume.drivers.quobyte [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86187) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG cinder.volume.drivers.quobyte [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86187) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86187) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG oslo_concurrency.processutils [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:32:03 devstack sudo[86301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:32:03 devstack sudo[86301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:32:03 devstack sudo[86301]: pam_unix(sudo:session): session closed for user root Nov 06 18:32:03 devstack cinder-volume[86187]: DEBUG oslo_concurrency.processutils [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.261s {{(pid=86187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:32:03 devstack cinder-volume[86187]: INFO cinder.volume.manager [None req-d23cd344-4845-48c4-96f0-36a901a206f3 None None] Driver post RPC initialization completed successfully. Nov 06 18:32:08 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [None req-6da24e71-5a54-412c-b9ad-059b68894688 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86187) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:32:08 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [None req-6da24e71-5a54-412c-b9ad-059b68894688 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86187) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:32:08 devstack cinder-volume[86187]: DEBUG cinder.volume.drivers.quobyte [None req-6da24e71-5a54-412c-b9ad-059b68894688 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86187) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:32:08 devstack cinder-volume[86187]: DEBUG cinder.volume.drivers.quobyte [None req-6da24e71-5a54-412c-b9ad-059b68894688 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86187) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:32:08 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [None req-6da24e71-5a54-412c-b9ad-059b68894688 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86187) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:32:08 devstack cinder-volume[86187]: DEBUG oslo_concurrency.processutils [None req-6da24e71-5a54-412c-b9ad-059b68894688 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:32:08 devstack sudo[86450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:32:08 devstack sudo[86450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:32:08 devstack cinder-volume[85970]: INFO oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Caught SIGTERM, stopping children Nov 06 18:32:08 devstack cinder-volume[85970]: DEBUG oslo_concurrency.lockutils [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Acquiring lock "singleton_lock" {{(pid=85970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 18:32:08 devstack cinder-volume[85970]: DEBUG oslo_concurrency.lockutils [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Acquired lock "singleton_lock" {{(pid=85970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 18:32:08 devstack cinder-volume[85970]: DEBUG oslo_concurrency.lockutils [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Releasing lock "singleton_lock" {{(pid=85970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 18:32:08 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Stop services. {{(pid=85970) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 18:32:08 devstack cinder-volume[85970]: DEBUG oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Killing children. {{(pid=85970) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 18:32:08 devstack cinder-volume[85970]: INFO oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Waiting on 1 children to exit Nov 06 18:32:08 devstack sudo[86450]: pam_unix(sudo:session): session closed for user root Nov 06 18:32:08 devstack cinder-volume[86187]: DEBUG oslo_concurrency.processutils [None req-6da24e71-5a54-412c-b9ad-059b68894688 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.294s {{(pid=86187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:32:08 devstack cinder-volume[86187]: DEBUG cinder.manager [None req-6da24e71-5a54-412c-b9ad-059b68894688 None None] Notifying Schedulers of capabilities ... {{(pid=86187) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6da24e71-5a54-412c-b9ad-059b68894688 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6da24e71-5a54-412c-b9ad-059b68894688 None None] Unable to connect to AMQP server on 192.168.122.68:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server [None req-6da24e71-5a54-412c-b9ad-059b68894688 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.68:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server method() Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1575, in _publish Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server self._producer.publish( Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server return _publish( Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server listener(*args) Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server raise error_for_code( Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server self.transport._send( Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 824, in send Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 799, in _send Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1694, in fanout_send Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1524, in _ensure_publishing Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1135, in ensure Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.68:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 06 18:32:08 devstack cinder-volume[86187]: ERROR oslo_messaging.rpc.server Nov 06 18:32:11 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Acquiring lock "singleton_lock" {{(pid=86187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 18:32:11 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Acquired lock "singleton_lock" {{(pid=86187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 18:32:11 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Releasing lock "singleton_lock" {{(pid=86187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 18:32:11 devstack cinder-volume[86187]: WARNING amqp [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 18:32:11 devstack cinder-volume[86187]: WARNING amqp [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 18:32:11 devstack cinder-volume[85970]: INFO oslo_service.backend._eventlet.service [None req-0ef3e3a9-eace-4dc0-a610-75384194d9de None None] Child 86187 exited with status 0 Nov 06 18:32:12 devstack cinder-volume[86501]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 18:32:12 devstack cinder-volume[86501]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 18:32:12 devstack cinder-volume[86501]: we strongly recommend against using it for new projects. Nov 06 18:32:12 devstack cinder-volume[86501]: If you are already using Eventlet, we recommend migrating to a different Nov 06 18:32:12 devstack cinder-volume[86501]: framework. For more detail see Nov 06 18:32:12 devstack cinder-volume[86501]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 18:32:12 devstack cinder-volume[86501]: import eventlet # noqa Nov 06 18:32:15 devstack cinder-volume[86501]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 18:32:15 devstack cinder-volume[86501]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 18:32:15 devstack cinder-volume[86501]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 18:32:15 devstack cinder-volume[86501]: INFO dbcounter [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] Registered counter for database cinder Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_db.sqlalchemy.engines [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86501) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG dbcounter [-] [86501] Writer thread running {{(pid=86501) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 18:32:16 devstack cinder-volume[86501]: INFO cinder.rpc [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 18:32:16 devstack cinder-volume[86501]: INFO cinder.rpc [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_db.sqlalchemy.engines [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86501) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 18:32:16 devstack cinder-volume[86501]: INFO cinder.volume.manager [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] Determined volume DB was empty at startup. Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG cinder.volume.manager [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86501) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 18:32:16 devstack cinder-volume[86501]: WARNING stevedore.named [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 18:32:16 devstack cinder-volume[86501]: WARNING castellan.key_manager [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 18:32:16 devstack cinder-volume[86501]: WARNING cinder.keymgr.conf_key_mgr [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 18:32:16 devstack cinder-volume[86501]: INFO cinder.volume.manager [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_db.sqlalchemy.engines [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86501) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 18:32:16 devstack cinder-volume[86501]: INFO oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] Starting 1 workers Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] Started child 86794 {{(pid=86501) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] Full set of CONF: {{(pid=86501) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] ******************************************************************************** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] Configuration options gathered from: {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] ================================================================================ {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] allow_availability_zone_fallback = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] allow_compression_on_image_upload = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] allowed_direct_url_schemes = [] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] api_rate_limit = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] auth_strategy = keystone {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_availability_zone = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_host = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_name = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_stats_polling_interval = 60 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backup_api_class = cinder.backup.api.API {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86794]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backup_name_template = backup-%s {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backup_use_same_host = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backup_use_temp_snapshot = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] chap_password = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] chap_username = {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cinder_internal_tenant_project_id = fbe803b2b9ff4026a2313eabe7a56418 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cinder_internal_tenant_user_id = 8509ac13e1834eb2921883a2dda8fda2 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cluster = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] compression_format = gzip {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] compute_api_class = cinder.compute.nova.API {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] config_dir = [] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] config_source = [] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] control_exchange = openstack {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] debug = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] default_availability_zone = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] default_group_type = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] default_volume_type = QuobyteHD {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] disk_geometry = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] driver_client_cert = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] driver_client_cert_key = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] driver_data_namespace = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] driver_ssl_cert_path = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] driver_ssl_cert_verify = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] driver_use_ssl = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] enable_new_services = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] enable_unsupported_driver = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] enabled_backends = ['QuobyteHD'] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] enforce_multipath_for_image_xfer = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] filter_function = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance_api_insecure = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance_api_servers = ['http://192.168.122.68/image'] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance_api_ssl_compression = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance_ca_certificates_file = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance_catalog_info = image:glance:publicURL {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance_certfile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance_keyfile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance_num_retries = 3 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance_preferred_stores = [] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance_request_timeout = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] goodness_function = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] graceful_shutdown_timeout = 5 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] group_api_class = cinder.group.api.API {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] host = devstack {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] image_compress_on_upload = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] image_conversion_address_space_limit = 1 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] image_conversion_cpu_limit = 60 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] image_conversion_disable = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] image_introspection_address_space_limit = 1 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] image_introspection_cpu_limit = 60 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] image_upload_use_cinder_backend = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] image_upload_use_internal_tenant = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] image_volume_cache_enabled = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] image_volume_cache_max_count = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] image_volume_cache_max_size_gb = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] init_host_max_objects_retrieval = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] instance_format = [instance: %(uuid)s] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] iscsi_target_flags = {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] iscsi_write_cache = on {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] iser_helper = tgtadm {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] iser_ip_address = 192.168.122.68 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] iser_port = 3260 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] log_color = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] log_config_append = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] log_dir = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] log_file = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] log_options = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] log_rotate_interval = 1 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] log_rotate_interval_type = days {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] log_rotation_type = none {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] max_age = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] max_logfile_count = 30 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] max_logfile_size_mb = 200 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] max_over_subscription_ratio = 20.0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] message_reap_interval = 86400 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] message_ttl = 2592000 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] migration_create_volume_timeout_secs = 300 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] monkey_patch = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] monkey_patch_modules = [] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] my_ip = 192.168.122.68 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] no_snapshot_gb_quota = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] num_iser_scan_tries = 3 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] num_shell_tries = 3 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] num_volume_device_scan_tries = 3 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] nvmeof_conn_info_version = 1 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] nvmet_ns_id = 10 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] nvmet_port_id = 1 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] osapi_max_limit = 1000 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] osapi_volume_ext_list = [] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] osapi_volume_listen_port = 8776 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] osapi_volume_use_ssl = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] osapi_volume_workers = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] per_volume_size_limit = -1 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] periodic_fuzzy_delay = 60 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] periodic_interval = 60 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] public_endpoint = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] publish_errors = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] quota_backup_gigabytes = 1000 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] quota_backups = 10 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] quota_gigabytes = 1000 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] quota_groups = 10 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] quota_snapshots = 10 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] quota_volumes = 10 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] rate_limit_burst = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] rate_limit_except_level = CRITICAL {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] rate_limit_interval = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] reinit_driver_count = 3 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] replication_device = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] report_discard_supported = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] report_interval = 120 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] reservation_clean_interval = 86400 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] reservation_expire = 86400 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] reserved_image_namespaces = [] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] reserved_percentage = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] rpc_response_timeout = 120 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] run_external_periodic_tasks = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] scst_target_driver = iscsi {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] scst_target_iqn_name = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] service_down_time = 720 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] shell_completion = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] snapshot_name_template = snapshot-%s {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] split_loggers = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] state_path = /opt/stack/data/cinder {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] storage_availability_zone = nova {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] storage_protocol = iSCSI {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] syslog_log_facility = LOG_USER {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] target_helper = lioadm {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] target_ip_address = 192.168.122.68 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] target_port = 3260 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] target_protocol = iscsi {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] target_secondary_ip_addresses = [] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] trace_flags = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] transport_url = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] until_refresh = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] use_chap_auth = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] use_default_quota_class = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] use_journal = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] use_json = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] use_multipath_for_image_xfer = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] use_stderr = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] use_syslog = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] verify_glance_signatures = enabled {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] volume_api_class = cinder.volume.api.API {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] volume_backend_name = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] volume_clear = zero {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] volume_clear_ionice = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] volume_clear_size = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] volume_copy_bps_limit = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] volume_dd_blocksize = 1M {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] volume_name_template = volume-%s {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] volume_service_inithost_offload = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] volume_usage_audit_period = month {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] zoning_mode = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_concurrency.disable_process_locking = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.auth_section = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.auth_type = password {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.auth_version = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.cache = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.certfile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.include_service_catalog = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.insecure = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.interface = public {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.keyfile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.memcache_password = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86794) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.memcache_username = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.region_name = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.service_type = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.68/identity {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.backend = dogpile.cache.null {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.backend_argument = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.backend_expiration_time = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.config_prefix = cache.oslo {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.debug_cache_backend = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.enable_retry_client = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.enable_socket_keepalive = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.enabled = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.expiration_time = 600 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.hashclient_retry_attempts = 2 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.memcache_dead_retry = 300 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.memcache_pool_maxsize = 10 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.memcache_sasl_enabled = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.password = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.proxies = [] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.redis_db = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.redis_server = localhost:6379 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.retry_attempts = 2 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.retry_delay = 0.0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.socket_keepalive_count = 1 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.socket_keepalive_idle = 1 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.socket_keepalive_interval = 1 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.socket_timeout = 1.0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.tls_allowed_ciphers = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.tls_cafile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.tls_certfile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.tls_enabled = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.tls_keyfile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cache.username = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] coordination.backend_url = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.asyncio_connection = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.asyncio_slave_connection = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.backend = sqlalchemy {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.connection = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.connection_debug = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.connection_parameters = {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.connection_recycle_time = 3600 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.connection_trace = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.db_inc_retry_interval = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.db_max_retries = 20 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.db_max_retry_interval = 10 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.db_retry_interval = 1 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.max_overflow = 50 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.max_pool_size = 5 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.max_retries = 10 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.mysql_wsrep_sync_wait = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.pool_timeout = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.retry_interval = 10 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.slave_connection = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.sqlite_synchronous = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.synchronous_reader = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] database.use_db_reconnect = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_tracing.insecure = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] profiler.connection_string = messaging:// {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] profiler.enabled = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] profiler.es_doc_type = notification {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] profiler.es_scroll_size = 10000 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] profiler.es_scroll_time = 2m {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] profiler.filter_error_trace = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] profiler.hmac_keys = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] profiler.sentinel_service_name = mymaster {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] profiler.socket_timeout = 0.1 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] profiler.trace_requests = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] profiler.trace_sqlalchemy = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] profiler_jaeger.process_tags = {} {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] profiler_jaeger.service_name_prefix = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] profiler_otlp.service_name_prefix = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_policy.enforce_new_defaults = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_policy.policy_default_rule = default {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_policy.policy_file = policy.yaml {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] privsep_osbrick.group = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] privsep_osbrick.helper_command = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] privsep_osbrick.user = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cinder_sys_admin.group = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cinder_sys_admin.helper_command = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] cinder_sys_admin.user = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] service_user.auth_section = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] service_user.auth_type = password {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] service_user.cafile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] service_user.certfile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] service_user.collect_timing = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] service_user.insecure = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] service_user.keyfile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] service_user.send_service_user_token = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] service_user.split_loggers = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] service_user.timeout = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] service_user.tls_ciphers = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] service_user.tls_min_version = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance.auth_section = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance.auth_type = password {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance.certfile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance.collect_timing = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance.insecure = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance.keyfile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance.region_name = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance.split_loggers = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance.timeout = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance.tls_ciphers = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] glance.tls_min_version = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.backend_availability_zone = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.chap_password = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.chap_username = {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.disk_geometry = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.driver_client_cert = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.driver_client_cert_key = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.driver_data_namespace = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.driver_use_ssl = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.extra_capabilities = {} {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.filter_function = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.goodness_function = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.iscsi_target_flags = {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.iscsi_write_cache = on {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.iser_helper = tgtadm {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.iser_ip_address = 192.168.122.68 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.iser_port = 3260 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.nas_host = {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.nas_login = admin {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.nas_mount_options = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.nas_password = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.nas_private_key = {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.nas_share_path = {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86794) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 18:32:16 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.quobyte [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 18:32:16 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.quobyte [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Running cmd (subprocess): mount.quobyte {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.num_shell_tries = 3 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.quobyte_volume_url = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.replication_device = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.report_discard_supported = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.reserved_percentage = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.target_helper = tgtadm {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.target_ip_address = 192.168.122.68 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.target_port = 3260 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.target_protocol = iscsi {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.trace_flags = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.unique_fqdn_network = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.use_chap_auth = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.volume_backend_name = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.volume_clear = zero {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.volume_clear_ionice = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.volume_clear_size = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_reports.file_event_handler = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_reports.log_dir = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.backend_availability_zone = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.backend_host = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.chap_password = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.chap_username = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.chiscsi_conf = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.disk_geometry = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.driver_client_cert = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.driver_data_namespace = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.driver_use_ssl = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.extra_capabilities = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.filter_function = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.goodness_function = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.iser_helper = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.iser_ip_address = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.iser_port = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.iser_target_prefix = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.nas_host = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.nas_login = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.nas_mount_options = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.nas_password = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.nas_private_key = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.nas_share_path = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.nas_ssh_port = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.num_shell_tries = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.nvmet_port_id = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.replication_device = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.report_discard_supported = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.reserved_percentage = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.scst_target_driver = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.storage_protocol = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.target_helper = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.target_ip_address = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.target_port = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.target_prefix = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.target_protocol = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.trace_flags = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.use_chap_auth = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.volume_clear = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.volume_clear_size = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] QuobyteHD.volumes_dir = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] CMD "mount.quobyte" returned: 1 in 0.073s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:16 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.ssl = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_notifications.driver = [] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_notifications.retry = -1 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] key_manager.fixed_key = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican.barbican_api_version = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican.barbican_endpoint = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican.barbican_endpoint_type = public {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican.barbican_region_name = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican.cafile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican.certfile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican.collect_timing = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican.insecure = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican.keyfile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican.number_of_retries = 60 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican.retry_delay = 1 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican.send_service_user_token = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican.split_loggers = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican.timeout = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican.tls_ciphers = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican.tls_min_version = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican.verify_ssl = True {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican.verify_ssl_path = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican_service_user.auth_section = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican_service_user.auth_type = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican_service_user.cafile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican_service_user.certfile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican_service_user.collect_timing = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican_service_user.insecure = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican_service_user.keyfile = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican_service_user.split_loggers = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican_service_user.timeout = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican_service_user.tls_ciphers = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] barbican_service_user.tls_min_version = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] vault.approle_role_id = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] vault.approle_secret_id = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] vault.auth_method = approle {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] vault.auth_path = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] vault.kv_mountpoint = secret {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] vault.kv_path = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] vault.kv_version = 2 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] vault.namespace = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] vault.root_token_id = **** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] vault.ssl_ca_crt_file = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] vault.timeout = 60.0 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] vault.token_file = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] vault.token_role = None {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] vault.use_ssl = False {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 18:32:17 devstack cinder-volume[86501]: DEBUG oslo_service.backend._eventlet.service [None req-27eaa28f-6a89-458f-b2b7-dfe94465fc05 None None] ******************************************************************************** {{(pid=86501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 18:32:17 devstack sudo[86805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:32:17 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:32:17 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.281s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:32:17 devstack cinder-volume[86794]: INFO cinder.volume.driver [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Driver hasn't implemented _init_vendor_properties() Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG cinder.volume.driver [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7579803466797, 'free_capacity_gb': 1773.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86794) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG oslo_db.sqlalchemy.engines [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86794) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writer thread running {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG cinder.db.api [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Building query based on filter {{(pid=86794) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86794) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1319}} Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:32:17 devstack cinder-volume[86794]: INFO cinder.keymgr.migration [None req-7c4fae7c-3ae5-43d4-9c52-f0628de76da8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 18:32:17 devstack sudo[86816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:32:17 devstack sudo[86816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:32:17 devstack sudo[86816]: pam_unix(sudo:session): session closed for user root Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.248s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:32:17 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Driver initialization completed successfully. Nov 06 18:32:17 devstack cinder-volume[86794]: INFO cinder.manager [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Initiating service 3 cleanup Nov 06 18:32:17 devstack cinder-volume[86794]: INFO cinder.manager [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Service 3 cleanup completed. Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG cinder.service [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Creating RPC server for service cinder-volume {{(pid=86794) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG cinder.service [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86794) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 18:32:17 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:32:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:32:17 devstack sudo[86829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:32:17 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:32:18 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root Nov 06 18:32:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.245s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:32:18 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-fb176b2e-46e4-4e26-8415-f034ceddd491 None None] Driver post RPC initialization completed successfully. Nov 06 18:32:26 devstack cinder-volume[86501]: DEBUG dbcounter [-] [86501] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86501) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:32:27 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:32:28 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=3 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:32:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:32:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 6 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:32:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:33:15 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-86ad96c2-171d-41b7-ba2c-a8fa305f439e tempest-GroupSnapshotsTest-56845106 None] Group tempest-GroupSnapshotsTest-Group-877946728: creating Nov 06 18:33:15 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-86ad96c2-171d-41b7-ba2c-a8fa305f439e tempest-GroupSnapshotsTest-56845106 None] Group tempest-GroupSnapshotsTest-Group-877946728: created successfully Nov 06 18:33:15 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-86ad96c2-171d-41b7-ba2c-a8fa305f439e tempest-GroupSnapshotsTest-56845106 None] Create group completed successfully. Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Flow 'volume_create_manager' (38c9f96e-a453-4a47-8bf2-367cc3175fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc059cac-f00c-4ae5-8ac5-0a68bb4dcf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc059cac-f00c-4ae5-8ac5-0a68bb4dcf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-133486715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4426454a-7b37-435d-8f36-14006d44e75e,host='devstack@QuobyteHD#QuobyteHD',id=ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ed65ddbf91416091b5ba23dc415422',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:33:18Z,use_quota=True,user_id='1312cbf347b4444db84b00b91a29ae23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7852d883-4209-4644-aa56-3d69dd5013f8),volume_type_id=7852d883-4209-4644-aa56-3d69dd5013f8)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b703f0-22e7-478f-9b7b-7e491e0769ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b703f0-22e7-478f-9b7b-7e491e0769ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6406da6-bd61-460c-a34c-0cf2b010edff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6406da6-bd61-460c-a34c-0cf2b010edff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe', 'volume_name': 'volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43a6601-90e3-4af4-9366-a11da805c3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43a6601-90e3-4af4-9366-a11da805c3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898888be-cd1e-4509-b094-f14e8f82b1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:18 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Volume ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe', 'volume_size': 1} Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4426454a-7b37-435d-8f36-14006d44e75e,created_at=2026-11-06T17:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-133486715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4426454a-7b37-435d-8f36-14006d44e75e,host='devstack@QuobyteHD#QuobyteHD',id=ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ed65ddbf91416091b5ba23dc415422',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:33:18Z,use_quota=True,user_id='1312cbf347b4444db84b00b91a29ae23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7852d883-4209-4644-aa56-3d69dd5013f8),volume_type_id=7852d883-4209-4644-aa56-3d69dd5013f8)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Creating volume ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:33:18 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:33:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:18 devstack sudo[87400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe 1073741824 Nov 06 18:33:18 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:19 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe 1073741824" returned: 0 in 0.988s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:19 devstack sudo[87725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe Nov 06 18:33:19 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:19 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe" returned: 0 in 0.539s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:33:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:33:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898888be-cd1e-4509-b094-f14e8f82b1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547b0c69-5aa9-484b-94dc-4865363b969e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:19 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Volume volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe (ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe): created successfully Nov 06 18:33:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547b0c69-5aa9-484b-94dc-4865363b969e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Flow 'volume_create_manager' (38c9f96e-a453-4a47-8bf2-367cc3175fc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:33:20 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-b6f40bf1-414f-41cd-89b7-8cd6858c64a1 tempest-GroupSnapshotsTest-56845106 None] Created volume successfully. Nov 06 18:33:21 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] GroupSnapshot 6704ca34-51c5-4ad7-96fe-d235bff621b6: creating. Nov 06 18:33:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] Group snapshot 6704ca34-51c5-4ad7-96fe-d235bff621b6: creating. {{(pid=86794) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 18:33:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:33:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:33:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] Creating offline snapshot 4047eef3-a895-4914-a6ec-2d541b139315 of volume ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:33:21 devstack cinder-volume[86794]: INFO oslo.privsep.daemon [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpmdcs7f23/privsep.sock'] Nov 06 18:33:21 devstack sudo[87802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpmdcs7f23/privsep.sock Nov 06 18:33:21 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:23 devstack cinder-volume[86794]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 06 18:33:23 devstack cinder-volume[86794]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 18:33:23 devstack cinder-volume[86794]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 06 18:33:23 devstack cinder-volume[86794]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 18:33:23 devstack cinder-volume[86794]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 06 18:33:23 devstack cinder-volume[86794]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 06 18:33:23 devstack cinder-volume[86794]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 18:33:23 devstack cinder-volume[86794]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 18:33:23 devstack cinder-volume[86794]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 06 18:33:23 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:23 devstack cinder-volume[86794]: INFO oslo.privsep.daemon [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] Spawned new privsep daemon via rootwrap Nov 06 18:33:24 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] Accepted privsep connection to /tmp/tmpmdcs7f23/privsep.sock {{(pid=86794) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 06 18:33:24 devstack cinder-volume[86794]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 06 18:33:24 devstack cinder-volume[86794]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 06 18:33:24 devstack cinder-volume[86794]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 06 18:33:24 devstack cinder-volume[86794]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87821 Nov 06 18:33:24 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7517049f-b9fb-437f-957b-aad7a9903aba]: (2,) {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:33:24 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccb4d70-7d87-460b-84ed-1610be7e87dc]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:33:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:24 devstack sudo[87825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe Nov 06 18:33:24 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:24 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe" returned: 0 in 0.734s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:24 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315 1G Nov 06 18:33:24 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:25 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315 1G" returned: 0 in 0.731s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:25 devstack sudo[87840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315 Nov 06 18:33:25 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:26 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:33:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Flow 'volume_create_manager' (11b85bec-ec48-4d1b-98d7-76dd8367e520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:33:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149e3c1c-d2b1-4aca-9b6f-dba59973d76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149e3c1c-d2b1-4aca-9b6f-dba59973d76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-781350715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bf1da7-4ebf-4d42-8120-ca1d2809dbc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb0309b454647deb1b2869fe68aef0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:33:26Z,use_quota=True,user_id='e97cd5d7e8cd4b13b0bcd090c95252ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c778e9cf-4499-4f9a-983f-d1f55fb5f411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c778e9cf-4499-4f9a-983f-d1f55fb5f411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d24132-8c5b-4c05-89e0-5f108b252634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d24132-8c5b-4c05-89e0-5f108b252634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59bf1da7-4ebf-4d42-8120-ca1d2809dbc0', 'volume_name': 'volume-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9deef55b-2dc7-49ee-b3dc-996dfb5ae895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9deef55b-2dc7-49ee-b3dc-996dfb5ae895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e04369-3bbb-4ec9-b4e3-d95251880e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:26 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Volume 59bf1da7-4ebf-4d42-8120-ca1d2809dbc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0', 'volume_size': 1} Nov 06 18:33:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:33:26 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315" returned: 0 in 0.624s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:26 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 18:33:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:26 devstack sudo[87845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315 Nov 06 18:33:26 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:26 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315" returned: 0 in 0.327s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:26 devstack sudo[87849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.info Nov 06 18:33:26 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:26 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.info" returned: 0 in 0.297s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:26 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 18:33:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:26 devstack sudo[87852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.info Nov 06 18:33:26 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:27 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.info" returned: 0 in 0.259s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.619s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:33:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.995s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:33:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-781350715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bf1da7-4ebf-4d42-8120-ca1d2809dbc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb0309b454647deb1b2869fe68aef0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:33:26Z,use_quota=True,user_id='e97cd5d7e8cd4b13b0bcd090c95252ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:33:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Creating volume 59bf1da7-4ebf-4d42-8120-ca1d2809dbc0 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:33:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:33:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:33:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:33:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:33:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:33:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:33:27 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:33:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:27 devstack sudo[87855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0 1073741824 Nov 06 18:33:27 devstack sudo[87855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:27 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-1c98c0b8-161e-43ce-9f74-4a4ebf9cc14e tempest-GroupSnapshotsTest-56845106 None] group_snapshot 6704ca34-51c5-4ad7-96fe-d235bff621b6: created successfully Nov 06 18:33:27 devstack sudo[87855]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0 1073741824" returned: 0 in 0.709s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:27 devstack sudo[87860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0 Nov 06 18:33:27 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:28 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0" returned: 0 in 0.447s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:33:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:33:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e04369-3bbb-4ec9-b4e3-d95251880e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfeba333-8580-4c2a-a24d-6d0be4a7b21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:28 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Volume volume-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0 (59bf1da7-4ebf-4d42-8120-ca1d2809dbc0): created successfully Nov 06 18:33:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfeba333-8580-4c2a-a24d-6d0be4a7b21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Flow 'volume_create_manager' (11b85bec-ec48-4d1b-98d7-76dd8367e520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:33:28 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-09f60f6e-7770-4836-a6b8-f07b412bce86 tempest-VolumesAdminNegativeTest-499929647 None] Created volume successfully. Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:29 devstack sudo[87887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:33:29 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:29 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.719s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 8 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "cinder-quobyte-4047eef3-a895-4914-a6ec-2d541b139315-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d" by "_create_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-4047eef3-a895-4914-a6ec-2d541b139315-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Creating volume dc2cf8f1-1405-4f31-a2e6-bafe15cba45d from snapshot 4047eef3-a895-4914-a6ec-2d541b139315 {{(pid=86794) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "cinder-quobyte-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d" by "_copy_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:33:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] snapshot: 4047eef3-a895-4914-a6ec-2d541b139315, volume: dc2cf8f1-1405-4f31-a2e6-bafe15cba45d, {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] Acquiring lock "cinder-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdef22f-dbfa-4638-9f4c-80197a0dd3be]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] Lock "cinder-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] Acquiring lock "cinder-quobyte-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] Lock "cinder-quobyte-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0" acquired by "delete_volume" :: waited 0.029s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7e5279-56e7-45f4-9a4d-47264ef4bfb5]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:30 devstack sudo[87892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315 Nov 06 18:33:30 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:30 devstack sudo[87893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0 Nov 06 18:33:30 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:30 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0" returned: 0 in 0.461s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:30 devstack sudo[87902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0 Nov 06 18:33:30 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:30 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315" returned: 0 in 0.702s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50ee280-c294-412a-ab97-4578cbb83565]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:30 devstack sudo[87904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe Nov 06 18:33:30 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:30 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0" returned: 0 in 0.271s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] Lock "cinder-quobyte-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0" released by "delete_volume" :: held 0.805s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:33:31 devstack cinder-volume[86794]: WARNING cinder.quota [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:33:31 devstack cinder-volume[86794]: WARNING cinder.quota [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:33:31 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] Created reservations ['03d09511-518e-489d-88f9-6c358476b002', '3d6f52b8-7454-485e-abab-c952cf56e963', '571fb6b3-5604-4a7f-962d-419fa81b1b49', '1e72a294-8046-4e43-b8bf-6240407bce92'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:33:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:33:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:33:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:33:31 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:33:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:33:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe" returned: 0 in 0.529s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 18:33:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Creating direct copy from snapshot {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 18:33:31 devstack cinder-volume[86794]: DEBUG cinder.utils [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Path /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d not found in is_blk_device check {{(pid=86794) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 18:33:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:31 devstack sudo[87910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:33:31 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:31 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d Nov 06 18:33:31 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:31 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.421s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:31 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:33:31 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] Deleted volume successfully. Nov 06 18:33:31 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-93e8fec6-3665-4ded-8efe-d9acd58832cf tempest-VolumesAdminNegativeTest-499929647 None] Lock "cinder-59bf1da7-4ebf-4d42-8120-ca1d2809dbc0-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:33:40 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d" returned: 0 in 9.634s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:40 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe, size 1024.00 MB, duration 9.64 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:33:40 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Converted 1024.00 MB image at 106.27 MB/s Nov 06 18:33:40 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d is being set with open permissions: ugo+rw: NotImplementedError Nov 06 18:33:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:40 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d Nov 06 18:33:40 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:41 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d" returned: 0 in 0.273s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d" released by "_copy_volume_from_snapshot" :: held 11.272s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:33:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-4047eef3-a895-4914-a6ec-2d541b139315-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d" released by "_create_volume_from_snapshot" :: held 11.378s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:33:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.418s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:33:41 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-df77aa36-5ec2-43b7-bb0f-0e0f9269ca4b tempest-GroupSnapshotsTest-56845106 None] Create group from source-snapshot-6704ca34-51c5-4ad7-96fe-d235bff621b6 completed successfully. Nov 06 18:33:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4321f0c0-6240-4fa8-a78f-66e392157aba tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "cinder-quobyte-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:33:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4321f0c0-6240-4fa8-a78f-66e392157aba tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d" acquired by "delete_volume" :: waited 0.034s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:33:42 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d48db75-d353-4e6f-af3a-50c2d4c9c809]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:33:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4321f0c0-6240-4fa8-a78f-66e392157aba tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:42 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d Nov 06 18:33:42 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:43 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4321f0c0-6240-4fa8-a78f-66e392157aba tempest-GroupSnapshotsTest-56845106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d" returned: 0 in 0.360s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4321f0c0-6240-4fa8-a78f-66e392157aba tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:43 devstack sudo[88025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d Nov 06 18:33:43 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:43 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4321f0c0-6240-4fa8-a78f-66e392157aba tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d" returned: 0 in 0.254s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4321f0c0-6240-4fa8-a78f-66e392157aba tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-dc2cf8f1-1405-4f31-a2e6-bafe15cba45d" released by "delete_volume" :: held 0.669s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:33:43 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-4321f0c0-6240-4fa8-a78f-66e392157aba tempest-GroupSnapshotsTest-56845106 None] Created reservations ['0c38e832-10e8-430f-938f-66a94b659d3f'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:33:43 devstack cinder-volume[86794]: WARNING cinder.quota [None req-4321f0c0-6240-4fa8-a78f-66e392157aba tempest-GroupSnapshotsTest-56845106 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1896769033 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1896769033, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:33:43 devstack cinder-volume[86794]: WARNING cinder.quota [None req-4321f0c0-6240-4fa8-a78f-66e392157aba tempest-GroupSnapshotsTest-56845106 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1896769033 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1896769033, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:33:43 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-4321f0c0-6240-4fa8-a78f-66e392157aba tempest-GroupSnapshotsTest-56845106 None] Created reservations ['e26b1ead-a270-4f3f-b97d-276b772c5d5f', 'dce7ad07-4d85-4496-92fe-9a04a01566c1', '0ce5fe22-6932-4f95-8a8e-a1c3f221adc2', 'ab3c3747-f1f1-4e5c-83dc-83791173d316'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:33:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4321f0c0-6240-4fa8-a78f-66e392157aba tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:33:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4321f0c0-6240-4fa8-a78f-66e392157aba tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:33:43 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4321f0c0-6240-4fa8-a78f-66e392157aba tempest-GroupSnapshotsTest-56845106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:33:43 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4321f0c0-6240-4fa8-a78f-66e392157aba tempest-GroupSnapshotsTest-56845106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:33:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4321f0c0-6240-4fa8-a78f-66e392157aba tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:33:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4321f0c0-6240-4fa8-a78f-66e392157aba tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:43 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:33:43 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:43 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4321f0c0-6240-4fa8-a78f-66e392157aba tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.298s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:44 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-4321f0c0-6240-4fa8-a78f-66e392157aba tempest-GroupSnapshotsTest-56845106 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:33:44 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-4321f0c0-6240-4fa8-a78f-66e392157aba tempest-GroupSnapshotsTest-56845106 None] Delete group completed successfully. Nov 06 18:33:44 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] group_snapshot 6704ca34-51c5-4ad7-96fe-d235bff621b6: deleting Nov 06 18:33:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] group_snapshot 6704ca34-51c5-4ad7-96fe-d235bff621b6: deleting {{(pid=86794) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 18:33:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "cinder-quobyte-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:33:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:33:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "cinder-quobyte-4047eef3-a895-4914-a6ec-2d541b139315" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:33:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-4047eef3-a895-4914-a6ec-2d541b139315" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:33:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] Deleting offline snapshot 4047eef3-a895-4914-a6ec-2d541b139315 of volume ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:33:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] snapshot_file for this snap is: volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:33:44 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b47a942-ad75-4af4-8771-d1a11bdb16ca]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:33:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:44 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315 Nov 06 18:33:44 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:44 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315" returned: 0 in 0.503s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:33:44 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9838849-fbbe-4b62-8d20-c4e14298af5d]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:33:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:44 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe Nov 06 18:33:44 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Flow 'volume_create_manager' (201d24be-e5cf-43db-a99a-125996cdc58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7095430-289d-47fa-a333-7cbb0e704304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7095430-289d-47fa-a333-7cbb0e704304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-592744639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54ddea4-20c3-41ed-9d8c-db970aa57fd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c60eee55d1b740a4ac82bf0c3cb9e262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:33:45Z,use_quota=True,user_id='19b6f6ee364f4ca9b2328336a94f7898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134bdfa2-a3ae-4a2a-ab8d-2bb3a90c9545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134bdfa2-a3ae-4a2a-ab8d-2bb3a90c9545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e513465-2043-47ef-990b-1b524fff96b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e513465-2043-47ef-990b-1b524fff96b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54ddea4-20c3-41ed-9d8c-db970aa57fd4', 'volume_name': 'volume-b54ddea4-20c3-41ed-9d8c-db970aa57fd4', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a1fbd9-27d0-4f99-adf6-aaeeef0e2cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a1fbd9-27d0-4f99-adf6-aaeeef0e2cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93db44f9-ad06-47d8-a81e-9c7bec33db7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:45 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Volume b54ddea4-20c3-41ed-9d8c-db970aa57fd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54ddea4-20c3-41ed-9d8c-db970aa57fd4', 'volume_size': 1} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-592744639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54ddea4-20c3-41ed-9d8c-db970aa57fd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c60eee55d1b740a4ac82bf0c3cb9e262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:33:45Z,use_quota=True,user_id='19b6f6ee364f4ca9b2328336a94f7898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Creating volume b54ddea4-20c3-41ed-9d8c-db970aa57fd4 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:33:45 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b54ddea4-20c3-41ed-9d8c-db970aa57fd4 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:45 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b54ddea4-20c3-41ed-9d8c-db970aa57fd4 1073741824 Nov 06 18:33:45 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:45 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe" returned: 0 in 0.691s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:45 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315 Nov 06 18:33:45 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:46 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315" returned: 0 in 0.613s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:46 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b54ddea4-20c3-41ed-9d8c-db970aa57fd4 1073741824" returned: 0 in 0.726s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:46 devstack sudo[88057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315 Nov 06 18:33:46 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b54ddea4-20c3-41ed-9d8c-db970aa57fd4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:46 devstack sudo[88059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b54ddea4-20c3-41ed-9d8c-db970aa57fd4 Nov 06 18:33:46 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:46 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b54ddea4-20c3-41ed-9d8c-db970aa57fd4" returned: 0 in 0.402s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:33:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:33:46 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe.4047eef3-a895-4914-a6ec-2d541b139315" returned: 0 in 0.491s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:46 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-4047eef3-a895-4914-a6ec-2d541b139315" released by "_delete_snapshot" :: held 2.467s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:33:46 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93db44f9-ad06-47d8-a81e-9c7bec33db7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54ddea4-20c3-41ed-9d8c-db970aa57fd4', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:46 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (036aa648-89c0-42ac-a031-a615da417dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:46 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe" released by "delete_snapshot" :: held 2.525s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:33:46 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Volume volume-b54ddea4-20c3-41ed-9d8c-db970aa57fd4 (b54ddea4-20c3-41ed-9d8c-db970aa57fd4): created successfully Nov 06 18:33:46 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (036aa648-89c0-42ac-a031-a615da417dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:46 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Flow 'volume_create_manager' (201d24be-e5cf-43db-a99a-125996cdc58d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:33:46 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-6be4581c-06ff-4cb6-b026-689671f4f799 tempest-ServerActionsTestOtherA-253261060 None] Created volume successfully. Nov 06 18:33:46 devstack cinder-volume[86794]: WARNING cinder.quota [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1896769033 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1896769033, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:33:46 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] Created reservations ['849348ac-11b1-46bc-8375-dae6b6886c97', '571932b9-639b-4861-8590-46f5eeb8c088', '90912edf-99a6-4f34-8b02-dab207f92930', 'c36960f6-0cb7-42f0-a209-458662491572'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:33:47 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-7b80b0cc-02c5-4f88-96db-0c7aadebfce4 tempest-GroupSnapshotsTest-56845106 None] group_snapshot 6704ca34-51c5-4ad7-96fe-d235bff621b6: deleted successfully Nov 06 18:33:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a916b02c-f1a4-467b-b85f-fa08ec6ebf77 tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "cinder-quobyte-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:33:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a916b02c-f1a4-467b-b85f-fa08ec6ebf77 tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe" acquired by "delete_volume" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:33:48 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f37027-e118-4180-b113-516f1adfc582]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:33:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a916b02c-f1a4-467b-b85f-fa08ec6ebf77 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:48 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe Nov 06 18:33:48 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:48 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a916b02c-f1a4-467b-b85f-fa08ec6ebf77 tempest-GroupSnapshotsTest-56845106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe" returned: 0 in 0.405s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a916b02c-f1a4-467b-b85f-fa08ec6ebf77 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:48 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe Nov 06 18:33:48 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:48 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a916b02c-f1a4-467b-b85f-fa08ec6ebf77 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe" returned: 0 in 0.292s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a916b02c-f1a4-467b-b85f-fa08ec6ebf77 tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-ff2e19a8-6bc6-4b9a-af7d-47f746c1fafe" released by "delete_volume" :: held 0.871s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:33:49 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-a916b02c-f1a4-467b-b85f-fa08ec6ebf77 tempest-GroupSnapshotsTest-56845106 None] Created reservations ['1aeced79-1fcf-41e9-8f81-100229f4a46b'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:33:49 devstack cinder-volume[86794]: WARNING cinder.db.api [None req-a916b02c-f1a4-467b-b85f-fa08ec6ebf77 tempest-GroupSnapshotsTest-56845106 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1896769033'] Nov 06 18:33:49 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-a916b02c-f1a4-467b-b85f-fa08ec6ebf77 tempest-GroupSnapshotsTest-56845106 None] Created reservations ['41fd77f8-4948-410d-a502-e788d1c694c6', 'e63db351-4eca-4080-bec3-0cd5ac127e94', 'a5947ca0-a916-483d-bc24-53063490c6b5', '95e29192-d784-40da-8201-942c05c90480'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:33:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a916b02c-f1a4-467b-b85f-fa08ec6ebf77 tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:33:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a916b02c-f1a4-467b-b85f-fa08ec6ebf77 tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:33:49 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a916b02c-f1a4-467b-b85f-fa08ec6ebf77 tempest-GroupSnapshotsTest-56845106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:33:49 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a916b02c-f1a4-467b-b85f-fa08ec6ebf77 tempest-GroupSnapshotsTest-56845106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:33:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a916b02c-f1a4-467b-b85f-fa08ec6ebf77 tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:33:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a916b02c-f1a4-467b-b85f-fa08ec6ebf77 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:49 devstack sudo[88080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:33:49 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:49 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a916b02c-f1a4-467b-b85f-fa08ec6ebf77 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.413s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:49 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-a916b02c-f1a4-467b-b85f-fa08ec6ebf77 tempest-GroupSnapshotsTest-56845106 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:33:49 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a916b02c-f1a4-467b-b85f-fa08ec6ebf77 tempest-GroupSnapshotsTest-56845106 None] Delete group completed successfully. Nov 06 18:33:49 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-48a7a679-91a8-42bd-9cfd-a07f2a054d0f tempest-GroupSnapshotsTest-56845106 None] Group tempest-GroupSnapshotsTest-Group-511721910: creating Nov 06 18:33:50 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-48a7a679-91a8-42bd-9cfd-a07f2a054d0f tempest-GroupSnapshotsTest-56845106 None] Group tempest-GroupSnapshotsTest-Group-511721910: created successfully Nov 06 18:33:50 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-48a7a679-91a8-42bd-9cfd-a07f2a054d0f tempest-GroupSnapshotsTest-56845106 None] Create group completed successfully. Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Flow 'volume_create_manager' (912a3964-b8d5-47b9-af91-bd79d7d6e40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d2bb37-9a53-47a8-94c4-22b34fc447f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d2bb37-9a53-47a8-94c4-22b34fc447f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1287718769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91ad51ab-0836-4d7f-b0c8-2cb84227f909,host='devstack@QuobyteHD#QuobyteHD',id=9a62b11e-a03a-46d8-9592-3e8f7fefecd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ed65ddbf91416091b5ba23dc415422',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:33:52Z,use_quota=True,user_id='1312cbf347b4444db84b00b91a29ae23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d79928b-e556-45ac-924f-f10e5870a3a9),volume_type_id=0d79928b-e556-45ac-924f-f10e5870a3a9)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e9bce8-351c-4595-a658-bc2595b59d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e9bce8-351c-4595-a658-bc2595b59d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517ad833-1bc8-4ee1-afcf-3a3d1a051878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517ad833-1bc8-4ee1-afcf-3a3d1a051878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a62b11e-a03a-46d8-9592-3e8f7fefecd4', 'volume_name': 'volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adea5cc7-334d-47e9-a3e8-d8a8e0c7c740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adea5cc7-334d-47e9-a3e8-d8a8e0c7c740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bccbd7-4560-45e0-9cb5-275b94c6b1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:52 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Volume 9a62b11e-a03a-46d8-9592-3e8f7fefecd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4', 'volume_size': 1} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=91ad51ab-0836-4d7f-b0c8-2cb84227f909,created_at=2026-11-06T17:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1287718769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91ad51ab-0836-4d7f-b0c8-2cb84227f909,host='devstack@QuobyteHD#QuobyteHD',id=9a62b11e-a03a-46d8-9592-3e8f7fefecd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ed65ddbf91416091b5ba23dc415422',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:33:52Z,use_quota=True,user_id='1312cbf347b4444db84b00b91a29ae23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d79928b-e556-45ac-924f-f10e5870a3a9),volume_type_id=0d79928b-e556-45ac-924f-f10e5870a3a9)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Creating volume 9a62b11e-a03a-46d8-9592-3e8f7fefecd4 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:33:52 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:52 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4 1073741824 Nov 06 18:33:52 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:52 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4 1073741824" returned: 0 in 0.686s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:52 devstack sudo[88102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4 Nov 06 18:33:52 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:53 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4" returned: 0 in 0.333s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:33:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:33:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bccbd7-4560-45e0-9cb5-275b94c6b1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3cfedeb-443f-4282-9865-0611895201f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:53 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Volume volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4 (9a62b11e-a03a-46d8-9592-3e8f7fefecd4): created successfully Nov 06 18:33:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3cfedeb-443f-4282-9865-0611895201f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Flow 'volume_create_manager' (912a3964-b8d5-47b9-af91-bd79d7d6e40f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:33:53 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-ae76d835-a89a-4198-9cfe-82a32050f2fc tempest-GroupSnapshotsTest-56845106 None] Created volume successfully. Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Flow 'volume_create_manager' (75b2fb31-efa7-4d6e-9423-05ce2dad2414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e044d5a-76bc-440e-b468-c56f21417388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e044d5a-76bc-440e-b468-c56f21417388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1437479293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91ad51ab-0836-4d7f-b0c8-2cb84227f909,host='devstack@QuobyteHD#QuobyteHD',id=beeb677a-c443-4347-bbda-f08b6c7bfc26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ed65ddbf91416091b5ba23dc415422',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:33:55Z,use_quota=True,user_id='1312cbf347b4444db84b00b91a29ae23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d79928b-e556-45ac-924f-f10e5870a3a9),volume_type_id=0d79928b-e556-45ac-924f-f10e5870a3a9)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf9547ca-8cb9-4cc7-9e6e-c747f901fdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf9547ca-8cb9-4cc7-9e6e-c747f901fdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce859f1e-774d-47ab-a053-affe518ee1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce859f1e-774d-47ab-a053-affe518ee1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beeb677a-c443-4347-bbda-f08b6c7bfc26', 'volume_name': 'volume-beeb677a-c443-4347-bbda-f08b6c7bfc26', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9d456d-a1fb-4a9b-984d-5bfd7fcfdbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9d456d-a1fb-4a9b-984d-5bfd7fcfdbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aacdaa06-bfae-4b37-9e77-5f194a215224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:55 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Volume beeb677a-c443-4347-bbda-f08b6c7bfc26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beeb677a-c443-4347-bbda-f08b6c7bfc26', 'volume_size': 1} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=91ad51ab-0836-4d7f-b0c8-2cb84227f909,created_at=2026-11-06T17:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1437479293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91ad51ab-0836-4d7f-b0c8-2cb84227f909,host='devstack@QuobyteHD#QuobyteHD',id=beeb677a-c443-4347-bbda-f08b6c7bfc26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ed65ddbf91416091b5ba23dc415422',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:33:55Z,use_quota=True,user_id='1312cbf347b4444db84b00b91a29ae23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d79928b-e556-45ac-924f-f10e5870a3a9),volume_type_id=0d79928b-e556-45ac-924f-f10e5870a3a9)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Creating volume beeb677a-c443-4347-bbda-f08b6c7bfc26 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:33:55 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:55 devstack sudo[88120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26 1073741824 Nov 06 18:33:55 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:55 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26 1073741824" returned: 0 in 0.630s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:33:55 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26 Nov 06 18:33:55 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:33:56 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Nov 06 18:33:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26" returned: 0 in 0.276s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:33:56 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:33:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:33:56 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aacdaa06-bfae-4b37-9e77-5f194a215224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beeb677a-c443-4347-bbda-f08b6c7bfc26', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:56 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f250be04-dcf7-4de2-b696-e2105f6241b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:33:56 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Volume volume-beeb677a-c443-4347-bbda-f08b6c7bfc26 (beeb677a-c443-4347-bbda-f08b6c7bfc26): created successfully Nov 06 18:33:56 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f250be04-dcf7-4de2-b696-e2105f6241b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:33:56 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Flow 'volume_create_manager' (75b2fb31-efa7-4d6e-9423-05ce2dad2414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:33:56 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-ab062ac3-5c14-4dae-8b70-0e2295cb0718 tempest-GroupSnapshotsTest-56845106 None] Created volume successfully. Nov 06 18:33:57 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-41c98ce7-93ad-4799-af97-1958d9d1eeee tempest-GroupSnapshotsTest-56845106 None] Update group completed successfully. Nov 06 18:33:59 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-9d13fd53-3b35-48f3-a76e-4fd74d0d9af7 tempest-GroupSnapshotsTest-56845106 None] Update group completed successfully. Nov 06 18:34:00 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-b9ae03cf-ed2c-4730-8510-7821b34c99df tempest-GroupSnapshotsTest-56845106 None] Update group completed successfully. Nov 06 18:34:01 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-dfb61a93-f57c-404b-beda-bf8a352072c4 tempest-GroupSnapshotsTest-56845106 None] Update group completed successfully. Nov 06 18:34:03 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] GroupSnapshot b7945728-4d43-4108-b814-4134b2c53372: creating. Nov 06 18:34:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Group snapshot b7945728-4d43-4108-b814-4134b2c53372: creating. {{(pid=86794) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 18:34:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:34:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:34:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Creating offline snapshot d5522c07-f5b3-4305-b2f4-ebd4e9c21603 of volume beeb677a-c443-4347-bbda-f08b6c7bfc26 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:34:03 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7119943-e2c0-4053-8e97-bf634cc24b09]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:34:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:04 devstack sudo[88181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26 Nov 06 18:34:04 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:04 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26" returned: 0 in 0.665s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.d5522c07-f5b3-4305-b2f4-ebd4e9c21603 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:04 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.d5522c07-f5b3-4305-b2f4-ebd4e9c21603 1G Nov 06 18:34:04 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:05 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.d5522c07-f5b3-4305-b2f4-ebd4e9c21603 1G" returned: 0 in 0.709s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beeb677a-c443-4347-bbda-f08b6c7bfc26 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.d5522c07-f5b3-4305-b2f4-ebd4e9c21603 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:05 devstack sudo[88192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beeb677a-c443-4347-bbda-f08b6c7bfc26 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.d5522c07-f5b3-4305-b2f4-ebd4e9c21603 Nov 06 18:34:05 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:05 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beeb677a-c443-4347-bbda-f08b6c7bfc26 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.d5522c07-f5b3-4305-b2f4-ebd4e9c21603" returned: 0 in 0.465s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:05 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.d5522c07-f5b3-4305-b2f4-ebd4e9c21603 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 18:34:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.d5522c07-f5b3-4305-b2f4-ebd4e9c21603 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:05 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.d5522c07-f5b3-4305-b2f4-ebd4e9c21603 Nov 06 18:34:05 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:06 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.d5522c07-f5b3-4305-b2f4-ebd4e9c21603" returned: 0 in 0.386s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:06 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.info Nov 06 18:34:06 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:06 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.info" returned: 0 in 0.375s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:06 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 18:34:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:06 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.info Nov 06 18:34:06 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:06 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.info" returned: 0 in 0.378s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.175s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:34:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:34:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:34:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Creating offline snapshot fe3cfa4a-b702-4181-af0a-96b0e0184e81 of volume 9a62b11e-a03a-46d8-9592-3e8f7fefecd4 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:34:07 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f537777-2217-4f2f-ab77-8badd3084b6a]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:34:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:07 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4 Nov 06 18:34:07 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:07 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4" returned: 0 in 0.546s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.fe3cfa4a-b702-4181-af0a-96b0e0184e81 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:07 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.fe3cfa4a-b702-4181-af0a-96b0e0184e81 1G Nov 06 18:34:07 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:08 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.fe3cfa4a-b702-4181-af0a-96b0e0184e81 1G" returned: 0 in 0.626s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.fe3cfa4a-b702-4181-af0a-96b0e0184e81 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:08 devstack sudo[88220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.fe3cfa4a-b702-4181-af0a-96b0e0184e81 Nov 06 18:34:08 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:08 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.fe3cfa4a-b702-4181-af0a-96b0e0184e81" returned: 0 in 0.528s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:08 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.fe3cfa4a-b702-4181-af0a-96b0e0184e81 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 18:34:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.fe3cfa4a-b702-4181-af0a-96b0e0184e81 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:08 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.fe3cfa4a-b702-4181-af0a-96b0e0184e81 Nov 06 18:34:08 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:09 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.fe3cfa4a-b702-4181-af0a-96b0e0184e81" returned: 0 in 0.268s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:09 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=69,cinder:UPDATE=57,cinder:DELETE=3,cinder:INSERT=13 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:34:09 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=61,cinder:UPDATE=66,cinder:INSERT=13,cinder:DELETE=3 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:34:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:09 devstack sudo[88234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.info Nov 06 18:34:09 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:09 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.info" returned: 0 in 0.503s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:09 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 18:34:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:09 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.info Nov 06 18:34:09 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:09 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.info" returned: 0 in 0.350s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.016s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:34:10 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-b2a31392-858f-4ac3-a8e7-bb7d03e13cb8 tempest-GroupSnapshotsTest-56845106 None] group_snapshot b7945728-4d43-4108-b814-4134b2c53372: created successfully Nov 06 18:34:10 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] group_snapshot b7945728-4d43-4108-b814-4134b2c53372: deleting Nov 06 18:34:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] group_snapshot b7945728-4d43-4108-b814-4134b2c53372: deleting {{(pid=86794) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 18:34:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "cinder-quobyte-beeb677a-c443-4347-bbda-f08b6c7bfc26" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:34:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-beeb677a-c443-4347-bbda-f08b6c7bfc26" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:34:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "cinder-quobyte-d5522c07-f5b3-4305-b2f4-ebd4e9c21603" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:34:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-d5522c07-f5b3-4305-b2f4-ebd4e9c21603" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:34:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Deleting offline snapshot d5522c07-f5b3-4305-b2f4-ebd4e9c21603 of volume beeb677a-c443-4347-bbda-f08b6c7bfc26 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:34:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] snapshot_file for this snap is: volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.d5522c07-f5b3-4305-b2f4-ebd4e9c21603 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:34:10 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6236fb4-02a4-451b-a51c-597a98ae1c32]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:34:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.d5522c07-f5b3-4305-b2f4-ebd4e9c21603 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:11 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.d5522c07-f5b3-4305-b2f4-ebd4e9c21603 Nov 06 18:34:11 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:11 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.d5522c07-f5b3-4305-b2f4-ebd4e9c21603" returned: 0 in 0.629s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beeb677a-c443-4347-bbda-f08b6c7bfc26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:34:11 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf438e0-4f44-4be3-af02-a132e03516be]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:34:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:11 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26 Nov 06 18:34:11 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:12 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26" returned: 0 in 0.631s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.d5522c07-f5b3-4305-b2f4-ebd4e9c21603 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:12 devstack sudo[88269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.d5522c07-f5b3-4305-b2f4-ebd4e9c21603 Nov 06 18:34:12 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:12 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.d5522c07-f5b3-4305-b2f4-ebd4e9c21603" returned: 0 in 0.636s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.d5522c07-f5b3-4305-b2f4-ebd4e9c21603 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:12 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.d5522c07-f5b3-4305-b2f4-ebd4e9c21603 Nov 06 18:34:12 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:13 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26.d5522c07-f5b3-4305-b2f4-ebd4e9c21603" returned: 0 in 0.409s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-d5522c07-f5b3-4305-b2f4-ebd4e9c21603" released by "_delete_snapshot" :: held 2.525s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:34:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-beeb677a-c443-4347-bbda-f08b6c7bfc26" released by "delete_snapshot" :: held 2.566s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:34:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "cinder-quobyte-9a62b11e-a03a-46d8-9592-3e8f7fefecd4" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:34:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-9a62b11e-a03a-46d8-9592-3e8f7fefecd4" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:34:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "cinder-quobyte-fe3cfa4a-b702-4181-af0a-96b0e0184e81" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:34:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-fe3cfa4a-b702-4181-af0a-96b0e0184e81" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:34:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Deleting offline snapshot fe3cfa4a-b702-4181-af0a-96b0e0184e81 of volume 9a62b11e-a03a-46d8-9592-3e8f7fefecd4 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:34:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] snapshot_file for this snap is: volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.fe3cfa4a-b702-4181-af0a-96b0e0184e81 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:34:13 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e46116-584c-4e74-90bb-2f9b7604d226]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:34:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.fe3cfa4a-b702-4181-af0a-96b0e0184e81 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:13 devstack sudo[88277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.fe3cfa4a-b702-4181-af0a-96b0e0184e81 Nov 06 18:34:13 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:14 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.fe3cfa4a-b702-4181-af0a-96b0e0184e81" returned: 0 in 0.656s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:34:14 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[5404987f-0a81-46af-b17e-73b1ffef6362]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:34:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:14 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4 Nov 06 18:34:14 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:14 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4" returned: 0 in 0.496s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.fe3cfa4a-b702-4181-af0a-96b0e0184e81 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:14 devstack sudo[88314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.fe3cfa4a-b702-4181-af0a-96b0e0184e81 Nov 06 18:34:14 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:15 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.fe3cfa4a-b702-4181-af0a-96b0e0184e81" returned: 0 in 0.739s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.fe3cfa4a-b702-4181-af0a-96b0e0184e81 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:15 devstack sudo[88363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.fe3cfa4a-b702-4181-af0a-96b0e0184e81 Nov 06 18:34:15 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:16 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4.fe3cfa4a-b702-4181-af0a-96b0e0184e81" returned: 0 in 0.631s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-fe3cfa4a-b702-4181-af0a-96b0e0184e81" released by "_delete_snapshot" :: held 2.706s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:34:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-9a62b11e-a03a-46d8-9592-3e8f7fefecd4" released by "delete_snapshot" :: held 2.758s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:34:16 devstack cinder-volume[86794]: WARNING cinder.quota [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1849137862 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1849137862, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:34:16 devstack cinder-volume[86794]: WARNING cinder.quota [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1849137862 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1849137862, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:34:16 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Created reservations ['d7b805a6-949a-4b3d-839d-083b8cdb7166', 'd483d211-a6e1-46e9-b60b-43bd947659c2', '1ce15dab-ff3e-4724-bd87-436ab1e1db42', '62d22efe-1ff6-4c88-9d08-fdcfb244c93b'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:34:16 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] Created reservations ['29fe73fc-9f95-4016-b6c6-8e2545a6b3dc', '6088e6a6-31f6-4dd3-b84b-6408ae8be2bb', 'be20ad17-2ac4-432b-b128-ff1b091c423d', '3c3a8665-0b9e-4d96-90a0-43b59ae41d52'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:34:16 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-84434fa4-009d-4142-a597-ff6be50d0e53 tempest-GroupSnapshotsTest-56845106 None] group_snapshot b7945728-4d43-4108-b814-4134b2c53372: deleted successfully Nov 06 18:34:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "cinder-quobyte-9a62b11e-a03a-46d8-9592-3e8f7fefecd4" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:34:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-9a62b11e-a03a-46d8-9592-3e8f7fefecd4" acquired by "delete_volume" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:34:17 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ba9d93-15ee-44cf-a371-be4f00ac137f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:34:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:17 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4 Nov 06 18:34:17 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:18 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4" returned: 0 in 0.520s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:18 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4 Nov 06 18:34:18 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:18 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a62b11e-a03a-46d8-9592-3e8f7fefecd4" returned: 0 in 0.404s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-9a62b11e-a03a-46d8-9592-3e8f7fefecd4" released by "delete_volume" :: held 1.039s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:34:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "cinder-quobyte-beeb677a-c443-4347-bbda-f08b6c7bfc26" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:34:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-beeb677a-c443-4347-bbda-f08b6c7bfc26" acquired by "delete_volume" :: waited 0.031s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:34:18 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac0771f-1052-46d0-abcc-d70586788a7f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:34:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:18 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26 Nov 06 18:34:18 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:19 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26" returned: 0 in 0.687s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:19 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26 Nov 06 18:34:19 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:19 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-beeb677a-c443-4347-bbda-f08b6c7bfc26" returned: 0 in 0.371s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-beeb677a-c443-4347-bbda-f08b6c7bfc26" released by "delete_volume" :: held 1.145s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:34:19 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Created reservations ['a3618671-6528-47dd-80ec-33e53ff4d877'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:34:19 devstack cinder-volume[86794]: WARNING cinder.quota [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1849137862 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1849137862, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:34:19 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Created reservations ['428f11f6-c51e-4b42-9231-b03d3098a17b', 'b7445ad0-0267-4831-a138-c467dea6d3e4', '4223c22d-e2ad-4586-812c-9a2211c00d5d', '9e1f0429-fb42-4ab4-922d-bb7f4693f01d'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:34:20 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Created reservations ['89fd770f-9fd5-480d-a49b-94816c94473b', 'c1c388a3-5c49-4a17-a861-5a9307407105', '1c1c0af3-54b8-4b5e-af9e-310b54a8134f', '0b47d1cd-4aeb-4b3c-82ec-2c78c1387339'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:34:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:34:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:34:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:34:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:34:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:34:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:20 devstack sudo[88436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:34:20 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:20 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.323s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:20 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:34:20 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-d122f8b1-ec78-4134-a960-826351f35ac1 tempest-GroupSnapshotsTest-56845106 None] Delete group completed successfully. Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Flow 'volume_create_manager' (9463dd95-f363-43a2-980b-768afd0390a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4df72a16-a829-4eef-9464-f452f3d8c7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4df72a16-a829-4eef-9464-f452f3d8c7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-51463418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd88683d-9d34-410c-93ef-f5e5a22207d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a3eba0e59a48ceb94f655bc62321e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:34:21Z,use_quota=True,user_id='4f25dc59c14e4502a38c556a57e584f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010b4cad-3e21-48ae-856c-b4ea6305066b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010b4cad-3e21-48ae-856c-b4ea6305066b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8273a5-0dde-4552-8a8a-3a51e0e75804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8273a5-0dde-4552-8a8a-3a51e0e75804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd88683d-9d34-410c-93ef-f5e5a22207d4', 'volume_name': 'volume-bd88683d-9d34-410c-93ef-f5e5a22207d4', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbf0e4a-8787-495f-a530-7e9c2461959e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbf0e4a-8787-495f-a530-7e9c2461959e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03296597-2fbb-4c50-a481-da636543cfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:34:21 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Volume bd88683d-9d34-410c-93ef-f5e5a22207d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd88683d-9d34-410c-93ef-f5e5a22207d4', 'volume_size': 1} Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-51463418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd88683d-9d34-410c-93ef-f5e5a22207d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a3eba0e59a48ceb94f655bc62321e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:34:21Z,use_quota=True,user_id='4f25dc59c14e4502a38c556a57e584f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Creating volume bd88683d-9d34-410c-93ef-f5e5a22207d4 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:34:21 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bd88683d-9d34-410c-93ef-f5e5a22207d4 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:21 devstack sudo[88439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bd88683d-9d34-410c-93ef-f5e5a22207d4 1073741824 Nov 06 18:34:21 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:21 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bd88683d-9d34-410c-93ef-f5e5a22207d4 1073741824" returned: 0 in 0.694s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bd88683d-9d34-410c-93ef-f5e5a22207d4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:22 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bd88683d-9d34-410c-93ef-f5e5a22207d4 Nov 06 18:34:22 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-8ad016b3-2aed-454e-a651-a4831aa6cd93 tempest-GroupSnapshotsTest-56845106 None] Group tempest-GroupSnapshotsTest-Group-103391191: creating Nov 06 18:34:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-8ad016b3-2aed-454e-a651-a4831aa6cd93 tempest-GroupSnapshotsTest-56845106 None] Group tempest-GroupSnapshotsTest-Group-103391191: created successfully Nov 06 18:34:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-8ad016b3-2aed-454e-a651-a4831aa6cd93 tempest-GroupSnapshotsTest-56845106 None] Create group completed successfully. Nov 06 18:34:22 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bd88683d-9d34-410c-93ef-f5e5a22207d4" returned: 0 in 0.549s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:22 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:34:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:34:22 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03296597-2fbb-4c50-a481-da636543cfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd88683d-9d34-410c-93ef-f5e5a22207d4', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:34:22 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d8ff8d-ebe8-4eec-956a-8d1eca9d9ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:34:22 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Volume volume-bd88683d-9d34-410c-93ef-f5e5a22207d4 (bd88683d-9d34-410c-93ef-f5e5a22207d4): created successfully Nov 06 18:34:22 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d8ff8d-ebe8-4eec-956a-8d1eca9d9ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:34:22 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Flow 'volume_create_manager' (9463dd95-f363-43a2-980b-768afd0390a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:34:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-60cb8811-e522-43fb-a142-9b9eade42cd2 tempest-DeleteServersTestJSON-72374814 None] Created volume successfully. Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Flow 'volume_create_manager' (751011a8-dae1-4cf0-bd0a-878be452c27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0138ac4-4220-42bd-9807-b38b2db1a807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0138ac4-4220-42bd-9807-b38b2db1a807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-275516832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2cba19a0-b7a0-4099-a13f-85c59e033f9a,host='devstack@QuobyteHD#QuobyteHD',id=ac94a64f-6571-4980-882e-4b994422dbf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ed65ddbf91416091b5ba23dc415422',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:34:24Z,use_quota=True,user_id='1312cbf347b4444db84b00b91a29ae23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68ba9c00-eacc-4393-843e-00185c140700),volume_type_id=68ba9c00-eacc-4393-843e-00185c140700)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080d9698-5d62-49e8-8b8a-eddd8753d1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080d9698-5d62-49e8-8b8a-eddd8753d1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7781d1-894d-4a49-a15c-e4df44e5b6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7781d1-894d-4a49-a15c-e4df44e5b6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac94a64f-6571-4980-882e-4b994422dbf1', 'volume_name': 'volume-ac94a64f-6571-4980-882e-4b994422dbf1', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b997e1b0-6b79-494d-8449-d875a904501b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b997e1b0-6b79-494d-8449-d875a904501b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b49c108-e43d-4137-af22-0efe3119e617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:34:24 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Volume ac94a64f-6571-4980-882e-4b994422dbf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac94a64f-6571-4980-882e-4b994422dbf1', 'volume_size': 1} Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2cba19a0-b7a0-4099-a13f-85c59e033f9a,created_at=2026-11-06T17:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-275516832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2cba19a0-b7a0-4099-a13f-85c59e033f9a,host='devstack@QuobyteHD#QuobyteHD',id=ac94a64f-6571-4980-882e-4b994422dbf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ed65ddbf91416091b5ba23dc415422',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:34:24Z,use_quota=True,user_id='1312cbf347b4444db84b00b91a29ae23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68ba9c00-eacc-4393-843e-00185c140700),volume_type_id=68ba9c00-eacc-4393-843e-00185c140700)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Creating volume ac94a64f-6571-4980-882e-4b994422dbf1 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:34:24 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:34:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:24 devstack sudo[88455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1 1073741824 Nov 06 18:34:24 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:25 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1 1073741824" returned: 0 in 0.840s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:25 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1 Nov 06 18:34:25 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:25 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1" returned: 0 in 0.342s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:34:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:34:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b49c108-e43d-4137-af22-0efe3119e617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac94a64f-6571-4980-882e-4b994422dbf1', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:34:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a85ee3-1022-4a93-b3ab-34378a074646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:34:25 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Volume volume-ac94a64f-6571-4980-882e-4b994422dbf1 (ac94a64f-6571-4980-882e-4b994422dbf1): created successfully Nov 06 18:34:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a85ee3-1022-4a93-b3ab-34378a074646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:34:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Flow 'volume_create_manager' (751011a8-dae1-4cf0-bd0a-878be452c27d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:34:25 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-39d72831-6125-48ad-9fc2-db53621325f6 tempest-GroupSnapshotsTest-56845106 None] Created volume successfully. Nov 06 18:34:27 devstack cinder-volume[86794]: WARNING py.warnings [req-20157f73-ced0-4995-abe5-8b8301e8f8fb req-bb728d38-3d17-4ac8-b124-5685f64c36a1 tempest-DeleteServersTestJSON-72374814 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 06 18:34:27 devstack cinder-volume[86794]: .first() Nov 06 18:34:27 devstack cinder-volume[86794]: Nov 06 18:34:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-20157f73-ced0-4995-abe5-8b8301e8f8fb req-bb728d38-3d17-4ac8-b124-5685f64c36a1 tempest-DeleteServersTestJSON-72374814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:34:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-20157f73-ced0-4995-abe5-8b8301e8f8fb req-bb728d38-3d17-4ac8-b124-5685f64c36a1 tempest-DeleteServersTestJSON-72374814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:34:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-20157f73-ced0-4995-abe5-8b8301e8f8fb req-bb728d38-3d17-4ac8-b124-5685f64c36a1 tempest-DeleteServersTestJSON-72374814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:34:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-20157f73-ced0-4995-abe5-8b8301e8f8fb req-bb728d38-3d17-4ac8-b124-5685f64c36a1 tempest-DeleteServersTestJSON-72374814 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-bd88683d-9d34-410c-93ef-f5e5a22207d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c242121-fb38-46db-93de-d7f7423dea78', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:34:27 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-20157f73-ced0-4995-abe5-8b8301e8f8fb req-bb728d38-3d17-4ac8-b124-5685f64c36a1 tempest-DeleteServersTestJSON-72374814 None] attachment_update completed successfully. Nov 06 18:34:27 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] GroupSnapshot 4ea3276e-8432-44ce-a10c-d650b148a683: creating. Nov 06 18:34:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] Group snapshot 4ea3276e-8432-44ce-a10c-d650b148a683: creating. {{(pid=86794) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 18:34:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:34:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:34:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] Creating offline snapshot fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e of volume ac94a64f-6571-4980-882e-4b994422dbf1 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:34:27 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[788862a7-82df-492a-a3cf-50f1fa263449]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:34:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:28 devstack sudo[88491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1 Nov 06 18:34:28 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:28 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1" returned: 0 in 1.018s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:28 devstack sudo[88927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e 1G Nov 06 18:34:28 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:34:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:34:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:34:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:34:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:34:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:34:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:29 devstack sudo[88936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:34:29 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:29 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.298s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:34:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:34:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 8 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:34:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:34:29 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e 1G" returned: 0 in 0.679s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac94a64f-6571-4980-882e-4b994422dbf1 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:29 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac94a64f-6571-4980-882e-4b994422dbf1 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e Nov 06 18:34:29 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-bf7c0c79-15ad-4f54-b750-bdb73f01d10e req-0840d7b1-7e34-4a67-b5bc-dfd99a07e4ef tempest-ServerActionsTestOtherA-253261060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:34:29 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac94a64f-6571-4980-882e-4b994422dbf1 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e" returned: 0 in 0.394s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:29 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e is being set with open permissions: ugo+rw: NotImplementedError Nov 06 18:34:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:29 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e Nov 06 18:34:29 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:30 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e" returned: 0 in 0.335s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:30 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.info Nov 06 18:34:30 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:30 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.info" returned: 0 in 0.436s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:30 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 18:34:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:30 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.info Nov 06 18:34:30 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:31 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.info" returned: 0 in 0.288s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.341s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:34:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-bf7c0c79-15ad-4f54-b750-bdb73f01d10e req-0840d7b1-7e34-4a67-b5bc-dfd99a07e4ef tempest-ServerActionsTestOtherA-253261060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.224s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:34:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-bf7c0c79-15ad-4f54-b750-bdb73f01d10e req-0840d7b1-7e34-4a67-b5bc-dfd99a07e4ef tempest-ServerActionsTestOtherA-253261060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:34:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-bf7c0c79-15ad-4f54-b750-bdb73f01d10e req-0840d7b1-7e34-4a67-b5bc-dfd99a07e4ef tempest-ServerActionsTestOtherA-253261060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-b54ddea4-20c3-41ed-9d8c-db970aa57fd4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9a43ece-bb59-4d9f-ad47-aba601f35735', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:34:31 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-061e57a2-af5a-4a6f-914a-8d4ac5ed5f4f tempest-GroupSnapshotsTest-56845106 None] group_snapshot 4ea3276e-8432-44ce-a10c-d650b148a683: created successfully Nov 06 18:34:31 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-bf7c0c79-15ad-4f54-b750-bdb73f01d10e req-0840d7b1-7e34-4a67-b5bc-dfd99a07e4ef tempest-ServerActionsTestOtherA-253261060 None] attachment_update completed successfully. Nov 06 18:34:32 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] group_snapshot 4ea3276e-8432-44ce-a10c-d650b148a683: deleting Nov 06 18:34:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] group_snapshot 4ea3276e-8432-44ce-a10c-d650b148a683: deleting {{(pid=86794) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 18:34:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "cinder-quobyte-ac94a64f-6571-4980-882e-4b994422dbf1" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:34:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-ac94a64f-6571-4980-882e-4b994422dbf1" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:34:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "cinder-quobyte-fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:34:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:34:32 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] Deleting offline snapshot fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e of volume ac94a64f-6571-4980-882e-4b994422dbf1 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:34:32 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] snapshot_file for this snap is: volume-ac94a64f-6571-4980-882e-4b994422dbf1.fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:34:32 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05fbd8f-5e39-447a-a6e0-e629c4ada890]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:34:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:32 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e Nov 06 18:34:32 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:33 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e" returned: 0 in 0.773s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac94a64f-6571-4980-882e-4b994422dbf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:34:33 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef69a8b-27b6-4545-8b82-ae24f923a43e]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:34:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:33 devstack sudo[89563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1 Nov 06 18:34:33 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:33 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-8ffe4eaa-e3c1-4b51-9afa-bfdfdbb41f75 req-1d38d18f-ba8e-4df2-b8c8-0d6b86111153 tempest-DeleteServersTestJSON-72374814 None] Terminate volume connection completed successfully. Nov 06 18:34:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-8ffe4eaa-e3c1-4b51-9afa-bfdfdbb41f75 req-1d38d18f-ba8e-4df2-b8c8-0d6b86111153 tempest-DeleteServersTestJSON-72374814 None] Deleting attachment 6c242121-fb38-46db-93de-d7f7423dea78. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:34:34 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1" returned: 0 in 0.661s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:34 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e Nov 06 18:34:34 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:34 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e" returned: 0 in 0.652s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:34 devstack sudo[89605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e Nov 06 18:34:34 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:35 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1.fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e" returned: 0 in 0.424s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:35 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-fc78ddc7-63c4-4a34-b9cb-0c4e6ff3fa1e" released by "_delete_snapshot" :: held 2.807s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:34:35 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-ac94a64f-6571-4980-882e-4b994422dbf1" released by "delete_snapshot" :: held 2.862s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:34:35 devstack cinder-volume[86794]: WARNING cinder.quota [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1847778794 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1847778794, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:34:35 devstack cinder-volume[86794]: WARNING cinder.quota [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1847778794 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1847778794, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:34:35 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] Created reservations ['e01683ea-f694-4401-967a-b7e4d44602e2', 'd3f5ad7a-f8dc-4af8-b7c9-e6e085a13e6e', 'a471a61f-768b-40cf-a9b4-915bfbbb62d7', 'a9697722-be05-4299-9a7b-03fa0a9ab2f9'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:34:35 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-bb8bcd60-c686-4d55-9e63-908ac9f64ecb tempest-GroupSnapshotsTest-56845106 None] group_snapshot 4ea3276e-8432-44ce-a10c-d650b148a683: deleted successfully Nov 06 18:34:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-0b4a6dec-3ab7-4188-89bc-70a748fc09f6 tempest-DeleteServersTestJSON-72374814 None] Acquiring lock "cinder-bd88683d-9d34-410c-93ef-f5e5a22207d4-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:34:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-0b4a6dec-3ab7-4188-89bc-70a748fc09f6 tempest-DeleteServersTestJSON-72374814 None] Lock "cinder-bd88683d-9d34-410c-93ef-f5e5a22207d4-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:34:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-0b4a6dec-3ab7-4188-89bc-70a748fc09f6 tempest-DeleteServersTestJSON-72374814 None] Acquiring lock "cinder-quobyte-bd88683d-9d34-410c-93ef-f5e5a22207d4" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:34:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-0b4a6dec-3ab7-4188-89bc-70a748fc09f6 tempest-DeleteServersTestJSON-72374814 None] Lock "cinder-quobyte-bd88683d-9d34-410c-93ef-f5e5a22207d4" acquired by "delete_volume" :: waited 0.023s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:34:36 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[f557da59-ccfc-42c4-ad5b-1f782118e7bc]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:34:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0b4a6dec-3ab7-4188-89bc-70a748fc09f6 tempest-DeleteServersTestJSON-72374814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bd88683d-9d34-410c-93ef-f5e5a22207d4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2da73d48-f88f-4c36-b724-05571c116cff tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "cinder-quobyte-ac94a64f-6571-4980-882e-4b994422dbf1" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:34:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2da73d48-f88f-4c36-b724-05571c116cff tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-ac94a64f-6571-4980-882e-4b994422dbf1" acquired by "delete_volume" :: waited 0.062s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:34:36 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bd88683d-9d34-410c-93ef-f5e5a22207d4 Nov 06 18:34:36 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:36 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[072d3402-ece8-4ee0-a742-c9220b242d98]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:34:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2da73d48-f88f-4c36-b724-05571c116cff tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:36 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1 Nov 06 18:34:36 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:37 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-1bbc5f45-a6c6-45a3-aa61-0c5fa6aee997 req-04770aef-adad-4420-b40b-40153269ad41 tempest-ServerActionsTestOtherA-253261060 None] Terminate volume connection completed successfully. Nov 06 18:34:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-1bbc5f45-a6c6-45a3-aa61-0c5fa6aee997 req-04770aef-adad-4420-b40b-40153269ad41 tempest-ServerActionsTestOtherA-253261060 None] Deleting attachment e9a43ece-bb59-4d9f-ad47-aba601f35735. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:34:37 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2da73d48-f88f-4c36-b724-05571c116cff tempest-GroupSnapshotsTest-56845106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1" returned: 0 in 0.474s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2da73d48-f88f-4c36-b724-05571c116cff tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:37 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0b4a6dec-3ab7-4188-89bc-70a748fc09f6 tempest-DeleteServersTestJSON-72374814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bd88683d-9d34-410c-93ef-f5e5a22207d4" returned: 0 in 0.811s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0b4a6dec-3ab7-4188-89bc-70a748fc09f6 tempest-DeleteServersTestJSON-72374814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bd88683d-9d34-410c-93ef-f5e5a22207d4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:37 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1 Nov 06 18:34:37 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:37 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bd88683d-9d34-410c-93ef-f5e5a22207d4 Nov 06 18:34:37 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:37 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2da73d48-f88f-4c36-b724-05571c116cff tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ac94a64f-6571-4980-882e-4b994422dbf1" returned: 0 in 0.662s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2da73d48-f88f-4c36-b724-05571c116cff tempest-GroupSnapshotsTest-56845106 None] Lock "cinder-quobyte-ac94a64f-6571-4980-882e-4b994422dbf1" released by "delete_volume" :: held 1.307s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:34:37 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0b4a6dec-3ab7-4188-89bc-70a748fc09f6 tempest-DeleteServersTestJSON-72374814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bd88683d-9d34-410c-93ef-f5e5a22207d4" returned: 0 in 0.723s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-0b4a6dec-3ab7-4188-89bc-70a748fc09f6 tempest-DeleteServersTestJSON-72374814 None] Lock "cinder-quobyte-bd88683d-9d34-410c-93ef-f5e5a22207d4" released by "delete_volume" :: held 1.641s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:34:38 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-2da73d48-f88f-4c36-b724-05571c116cff tempest-GroupSnapshotsTest-56845106 None] Created reservations ['b35fdb50-086d-4bba-be4e-987cc646ec99'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:34:38 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-0b4a6dec-3ab7-4188-89bc-70a748fc09f6 tempest-DeleteServersTestJSON-72374814 None] Created reservations ['d54af15a-c9f4-4d28-ac55-a58a35d49627', 'ff0161e9-5f13-4dc7-a34f-886123a2018c', '500660f3-73b0-45cd-8eb9-8156d96db1c7', '6354388a-a33c-4b28-ac0f-539754cf70e7'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:34:38 devstack cinder-volume[86794]: WARNING cinder.quota [None req-2da73d48-f88f-4c36-b724-05571c116cff tempest-GroupSnapshotsTest-56845106 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1847778794 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1847778794, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:34:38 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-2da73d48-f88f-4c36-b724-05571c116cff tempest-GroupSnapshotsTest-56845106 None] Created reservations ['a0b9e999-14d8-46d0-80d3-cb903e6594b6', '2c49e439-7cba-4dd9-8fdd-7f8d02ad676c', 'b9d99df6-d749-4997-819a-996f4d140b04', 'a136719f-4a48-4f5b-93ae-3886cd5f96df'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:34:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0b4a6dec-3ab7-4188-89bc-70a748fc09f6 tempest-DeleteServersTestJSON-72374814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:34:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0b4a6dec-3ab7-4188-89bc-70a748fc09f6 tempest-DeleteServersTestJSON-72374814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:34:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0b4a6dec-3ab7-4188-89bc-70a748fc09f6 tempest-DeleteServersTestJSON-72374814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:34:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0b4a6dec-3ab7-4188-89bc-70a748fc09f6 tempest-DeleteServersTestJSON-72374814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:34:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0b4a6dec-3ab7-4188-89bc-70a748fc09f6 tempest-DeleteServersTestJSON-72374814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:34:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0b4a6dec-3ab7-4188-89bc-70a748fc09f6 tempest-DeleteServersTestJSON-72374814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:38 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:34:38 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2da73d48-f88f-4c36-b724-05571c116cff tempest-GroupSnapshotsTest-56845106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:34:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2da73d48-f88f-4c36-b724-05571c116cff tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:34:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2da73d48-f88f-4c36-b724-05571c116cff tempest-GroupSnapshotsTest-56845106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:34:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2da73d48-f88f-4c36-b724-05571c116cff tempest-GroupSnapshotsTest-56845106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:34:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2da73d48-f88f-4c36-b724-05571c116cff tempest-GroupSnapshotsTest-56845106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:34:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2da73d48-f88f-4c36-b724-05571c116cff tempest-GroupSnapshotsTest-56845106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:38 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:34:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-1bbc5f45-a6c6-45a3-aa61-0c5fa6aee997 req-0f0d913a-99a4-4b09-b1dc-d20a6e11ac4b tempest-ServerActionsTestOtherA-253261060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:34:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-1bbc5f45-a6c6-45a3-aa61-0c5fa6aee997 req-0f0d913a-99a4-4b09-b1dc-d20a6e11ac4b tempest-ServerActionsTestOtherA-253261060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:34:38 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-1bbc5f45-a6c6-45a3-aa61-0c5fa6aee997 req-0f0d913a-99a4-4b09-b1dc-d20a6e11ac4b tempest-ServerActionsTestOtherA-253261060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:34:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-1bbc5f45-a6c6-45a3-aa61-0c5fa6aee997 req-0f0d913a-99a4-4b09-b1dc-d20a6e11ac4b tempest-ServerActionsTestOtherA-253261060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-b54ddea4-20c3-41ed-9d8c-db970aa57fd4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '81db69cc-9c2a-47ce-b665-c02f1e056b8b', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:34:39 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0b4a6dec-3ab7-4188-89bc-70a748fc09f6 tempest-DeleteServersTestJSON-72374814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.799s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:39 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-0b4a6dec-3ab7-4188-89bc-70a748fc09f6 tempest-DeleteServersTestJSON-72374814 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:34:39 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:39 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-0b4a6dec-3ab7-4188-89bc-70a748fc09f6 tempest-DeleteServersTestJSON-72374814 None] Deleted volume successfully. Nov 06 18:34:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2da73d48-f88f-4c36-b724-05571c116cff tempest-GroupSnapshotsTest-56845106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.480s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:39 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-2da73d48-f88f-4c36-b724-05571c116cff tempest-GroupSnapshotsTest-56845106 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:34:39 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-1bbc5f45-a6c6-45a3-aa61-0c5fa6aee997 req-0f0d913a-99a4-4b09-b1dc-d20a6e11ac4b tempest-ServerActionsTestOtherA-253261060 None] attachment_update completed successfully. Nov 06 18:34:39 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-2da73d48-f88f-4c36-b724-05571c116cff tempest-GroupSnapshotsTest-56845106 None] Delete group completed successfully. Nov 06 18:34:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-0b4a6dec-3ab7-4188-89bc-70a748fc09f6 tempest-DeleteServersTestJSON-72374814 None] Lock "cinder-bd88683d-9d34-410c-93ef-f5e5a22207d4-delete_volume" released by "delete_volume" :: held 3.001s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:34:49 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=86,cinder:UPDATE=71,cinder:INSERT=15 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:34:49 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=79,cinder:INSERT=19,cinder:UPDATE=74,cinder:DELETE=3 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Flow 'volume_create_manager' (036ef895-9562-4ec5-88d2-4894f3d7b1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4fe70ce-a1fb-4868-9de3-6a1002023cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4fe70ce-a1fb-4868-9de3-6a1002023cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1392810902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f73fa65-2646-4160-bbe2-910b9c16990a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c510e285194108b5b97f7f494c1e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:34:58Z,use_quota=True,user_id='52d5c389b5714776a66f34a787ad1a60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d56493-8368-4be5-bab6-5f083d556b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d56493-8368-4be5-bab6-5f083d556b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b754b449-5a3e-4f16-bb4f-f1510966b0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b754b449-5a3e-4f16-bb4f-f1510966b0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f73fa65-2646-4160-bbe2-910b9c16990a', 'volume_name': 'volume-3f73fa65-2646-4160-bbe2-910b9c16990a', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69070013-4514-4f08-84c8-252e9461e6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69070013-4514-4f08-84c8-252e9461e6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7854806-314f-4223-bb13-939df9d28d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:34:58 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Volume 3f73fa65-2646-4160-bbe2-910b9c16990a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f73fa65-2646-4160-bbe2-910b9c16990a', 'volume_size': 1} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1392810902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f73fa65-2646-4160-bbe2-910b9c16990a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c510e285194108b5b97f7f494c1e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:34:58Z,use_quota=True,user_id='52d5c389b5714776a66f34a787ad1a60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Creating volume 3f73fa65-2646-4160-bbe2-910b9c16990a {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:34:58 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:34:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3f73fa65-2646-4160-bbe2-910b9c16990a 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:58 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3f73fa65-2646-4160-bbe2-910b9c16990a 1073741824 Nov 06 18:34:58 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:59 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3f73fa65-2646-4160-bbe2-910b9c16990a 1073741824" returned: 0 in 0.669s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3f73fa65-2646-4160-bbe2-910b9c16990a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:34:59 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3f73fa65-2646-4160-bbe2-910b9c16990a Nov 06 18:34:59 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:34:59 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Nov 06 18:34:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3f73fa65-2646-4160-bbe2-910b9c16990a" returned: 0 in 0.278s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:34:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:34:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:34:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7854806-314f-4223-bb13-939df9d28d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f73fa65-2646-4160-bbe2-910b9c16990a', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:34:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (001be833-4716-4cb5-8157-3967fcb7d470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:34:59 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Volume volume-3f73fa65-2646-4160-bbe2-910b9c16990a (3f73fa65-2646-4160-bbe2-910b9c16990a): created successfully Nov 06 18:34:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (001be833-4716-4cb5-8157-3967fcb7d470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:34:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Flow 'volume_create_manager' (036ef895-9562-4ec5-88d2-4894f3d7b1e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:34:59 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-289144df-8a6e-47e1-8afc-fcfb43a9ac32 tempest-ServersNegativeTestJSON-1158089865 None] Created volume successfully. Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Flow 'volume_create_manager' (5ac973f2-375c-4b4d-aba2-684bb1bcf161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9237b7-31bc-4407-bafb-54656a47b5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9237b7-31bc-4407-bafb-54656a47b5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-778326991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ebe146-b4b2-4af7-8359-ee1039ae8391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c510e285194108b5b97f7f494c1e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:35:02Z,use_quota=True,user_id='52d5c389b5714776a66f34a787ad1a60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bc97db-d38b-4599-b63f-61523863890e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bc97db-d38b-4599-b63f-61523863890e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7123fab5-cc4b-4c8e-984c-dd643b4e1ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7123fab5-cc4b-4c8e-984c-dd643b4e1ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3ebe146-b4b2-4af7-8359-ee1039ae8391', 'volume_name': 'volume-e3ebe146-b4b2-4af7-8359-ee1039ae8391', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3376e82-2597-4fed-b070-a936674c115b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3376e82-2597-4fed-b070-a936674c115b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2878c883-5a7d-40a7-be4c-58a2ae64b83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:02 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Volume e3ebe146-b4b2-4af7-8359-ee1039ae8391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3ebe146-b4b2-4af7-8359-ee1039ae8391', 'volume_size': 1} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-778326991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ebe146-b4b2-4af7-8359-ee1039ae8391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c510e285194108b5b97f7f494c1e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:35:02Z,use_quota=True,user_id='52d5c389b5714776a66f34a787ad1a60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Creating volume e3ebe146-b4b2-4af7-8359-ee1039ae8391 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:35:02 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e3ebe146-b4b2-4af7-8359-ee1039ae8391 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:02 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e3ebe146-b4b2-4af7-8359-ee1039ae8391 1073741824 Nov 06 18:35:02 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:02 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-5c3a45a4-015e-459f-bf9d-0d3a3b4f700a tempest-GroupsV314Test-72644694 None] Group tempest-GroupsV314Test-Group-1838350281: creating Nov 06 18:35:02 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-5c3a45a4-015e-459f-bf9d-0d3a3b4f700a tempest-GroupsV314Test-72644694 None] Group tempest-GroupsV314Test-Group-1838350281: created successfully Nov 06 18:35:02 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-5c3a45a4-015e-459f-bf9d-0d3a3b4f700a tempest-GroupsV314Test-72644694 None] Create group completed successfully. Nov 06 18:35:02 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e3ebe146-b4b2-4af7-8359-ee1039ae8391 1073741824" returned: 0 in 0.566s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e3ebe146-b4b2-4af7-8359-ee1039ae8391 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:02 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e3ebe146-b4b2-4af7-8359-ee1039ae8391 Nov 06 18:35:02 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:02 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e3ebe146-b4b2-4af7-8359-ee1039ae8391" returned: 0 in 0.271s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:35:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:35:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2878c883-5a7d-40a7-be4c-58a2ae64b83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3ebe146-b4b2-4af7-8359-ee1039ae8391', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a126525-e24b-4273-b79d-4ddf2c846af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:03 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Volume volume-e3ebe146-b4b2-4af7-8359-ee1039ae8391 (e3ebe146-b4b2-4af7-8359-ee1039ae8391): created successfully Nov 06 18:35:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a126525-e24b-4273-b79d-4ddf2c846af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Flow 'volume_create_manager' (5ac973f2-375c-4b4d-aba2-684bb1bcf161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:35:03 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-1da16ce5-83fb-48d6-a071-817cad67fdbe tempest-ServersNegativeTestJSON-1158089865 None] Created volume successfully. Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Flow 'volume_create_manager' (900f5c4c-1d35-48a0-9d69-110991fa18cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2fea116-eced-4059-9bb1-4f4fd6480634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2fea116-eced-4059-9bb1-4f4fd6480634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1680481134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84f6e7b4-b120-4659-bb2c-49614440d7a3,host='devstack@QuobyteHD#QuobyteHD',id=e9566b13-1bff-4a31-8249-71f98c17fb96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb60908a686d43e7b459423412b45914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:35:04Z,use_quota=True,user_id='5fd25bb6d33044a49bef70380f59e736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1bbbed77-5260-44c3-beba-1e047e726f55),volume_type_id=1bbbed77-5260-44c3-beba-1e047e726f55)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d00bb4-0e73-4127-b3d8-1e2e72108ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d00bb4-0e73-4127-b3d8-1e2e72108ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d776d6a6-356c-4352-9769-bd45739ea027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d776d6a6-356c-4352-9769-bd45739ea027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9566b13-1bff-4a31-8249-71f98c17fb96', 'volume_name': 'volume-e9566b13-1bff-4a31-8249-71f98c17fb96', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ceebd2f-0cf0-4d55-b15d-d91cca0927cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ceebd2f-0cf0-4d55-b15d-d91cca0927cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc34bc30-9e3f-46c8-a8bd-76d089148be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:04 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Volume e9566b13-1bff-4a31-8249-71f98c17fb96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9566b13-1bff-4a31-8249-71f98c17fb96', 'volume_size': 1} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=84f6e7b4-b120-4659-bb2c-49614440d7a3,created_at=2026-11-06T17:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1680481134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84f6e7b4-b120-4659-bb2c-49614440d7a3,host='devstack@QuobyteHD#QuobyteHD',id=e9566b13-1bff-4a31-8249-71f98c17fb96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb60908a686d43e7b459423412b45914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:35:04Z,use_quota=True,user_id='5fd25bb6d33044a49bef70380f59e736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1bbbed77-5260-44c3-beba-1e047e726f55),volume_type_id=1bbbed77-5260-44c3-beba-1e047e726f55)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Creating volume e9566b13-1bff-4a31-8249-71f98c17fb96 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:35:04 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:04 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96 1073741824 Nov 06 18:35:04 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d0af81b9-fd8e-44c2-a68b-ca753e272906 tempest-ServersNegativeTestJSON-1158089865 None] Acquiring lock "cinder-e3ebe146-b4b2-4af7-8359-ee1039ae8391-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d0af81b9-fd8e-44c2-a68b-ca753e272906 tempest-ServersNegativeTestJSON-1158089865 None] Lock "cinder-e3ebe146-b4b2-4af7-8359-ee1039ae8391-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d0af81b9-fd8e-44c2-a68b-ca753e272906 tempest-ServersNegativeTestJSON-1158089865 None] Acquiring lock "cinder-quobyte-e3ebe146-b4b2-4af7-8359-ee1039ae8391" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d0af81b9-fd8e-44c2-a68b-ca753e272906 tempest-ServersNegativeTestJSON-1158089865 None] Lock "cinder-quobyte-e3ebe146-b4b2-4af7-8359-ee1039ae8391" acquired by "delete_volume" :: waited 0.035s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c188c83-1f96-4ed1-aede-73682ebbc89b]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d0af81b9-fd8e-44c2-a68b-ca753e272906 tempest-ServersNegativeTestJSON-1158089865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e3ebe146-b4b2-4af7-8359-ee1039ae8391 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:04 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96 1073741824" returned: 0 in 0.586s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:04 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e3ebe146-b4b2-4af7-8359-ee1039ae8391 Nov 06 18:35:04 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:04 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96 Nov 06 18:35:04 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:05 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96" returned: 0 in 0.278s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:35:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:35:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc34bc30-9e3f-46c8-a8bd-76d089148be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9566b13-1bff-4a31-8249-71f98c17fb96', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da689ce-75a8-45e9-a083-bb7b52c24a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:05 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d0af81b9-fd8e-44c2-a68b-ca753e272906 tempest-ServersNegativeTestJSON-1158089865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e3ebe146-b4b2-4af7-8359-ee1039ae8391" returned: 0 in 0.437s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d0af81b9-fd8e-44c2-a68b-ca753e272906 tempest-ServersNegativeTestJSON-1158089865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e3ebe146-b4b2-4af7-8359-ee1039ae8391 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:05 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Volume volume-e9566b13-1bff-4a31-8249-71f98c17fb96 (e9566b13-1bff-4a31-8249-71f98c17fb96): created successfully Nov 06 18:35:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da689ce-75a8-45e9-a083-bb7b52c24a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Flow 'volume_create_manager' (900f5c4c-1d35-48a0-9d69-110991fa18cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:35:05 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e3ebe146-b4b2-4af7-8359-ee1039ae8391 Nov 06 18:35:05 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:05 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-95200fcc-abca-4c8f-af59-f34823cefdc6 tempest-GroupsV314Test-72644694 None] Created volume successfully. Nov 06 18:35:05 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d0af81b9-fd8e-44c2-a68b-ca753e272906 tempest-ServersNegativeTestJSON-1158089865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e3ebe146-b4b2-4af7-8359-ee1039ae8391" returned: 0 in 0.560s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:05 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d0af81b9-fd8e-44c2-a68b-ca753e272906 tempest-ServersNegativeTestJSON-1158089865 None] Lock "cinder-quobyte-e3ebe146-b4b2-4af7-8359-ee1039ae8391" released by "delete_volume" :: held 1.075s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:35:05 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-d0af81b9-fd8e-44c2-a68b-ca753e272906 tempest-ServersNegativeTestJSON-1158089865 None] Created reservations ['4b2c10e1-64e5-41a1-bae9-b5ebc9a9dfd9', 'a8772537-f9f0-4bf6-841a-bec22151f005', '739e925e-962f-4ed7-a99d-2f1891397fc8', 'e669e1ad-7712-4b21-a66b-3a7804868729'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:35:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d0af81b9-fd8e-44c2-a68b-ca753e272906 tempest-ServersNegativeTestJSON-1158089865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:35:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d0af81b9-fd8e-44c2-a68b-ca753e272906 tempest-ServersNegativeTestJSON-1158089865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:35:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d0af81b9-fd8e-44c2-a68b-ca753e272906 tempest-ServersNegativeTestJSON-1158089865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:35:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d0af81b9-fd8e-44c2-a68b-ca753e272906 tempest-ServersNegativeTestJSON-1158089865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:35:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d0af81b9-fd8e-44c2-a68b-ca753e272906 tempest-ServersNegativeTestJSON-1158089865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:35:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d0af81b9-fd8e-44c2-a68b-ca753e272906 tempest-ServersNegativeTestJSON-1158089865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:06 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:35:06 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:35:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:35:06 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Cloning volume e9566b13-1bff-4a31-8249-71f98c17fb96 to volume a7d29496-5f52-454d-bd6d-a9c1638ac7f7 Nov 06 18:35:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Creating offline snapshot e0845e93-3971-43f0-ae90-0acacb25ae01 of volume e9566b13-1bff-4a31-8249-71f98c17fb96 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:35:06 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:06 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f99046-e4d5-4d4d-ba71-14cfe476cb8b]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:35:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d0af81b9-fd8e-44c2-a68b-ca753e272906 tempest-ServersNegativeTestJSON-1158089865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.397s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:06 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-d0af81b9-fd8e-44c2-a68b-ca753e272906 tempest-ServersNegativeTestJSON-1158089865 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:35:06 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-d0af81b9-fd8e-44c2-a68b-ca753e272906 tempest-ServersNegativeTestJSON-1158089865 None] Deleted volume successfully. Nov 06 18:35:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d0af81b9-fd8e-44c2-a68b-ca753e272906 tempest-ServersNegativeTestJSON-1158089865 None] Lock "cinder-e3ebe146-b4b2-4af7-8359-ee1039ae8391-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:35:06 devstack sudo[90414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96 Nov 06 18:35:06 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:06 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96" returned: 0 in 0.595s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a5c580f-f60c-4e99-ad74-c17f5d1b4ec8 tempest-ServersNegativeTestJSON-1158089865 None] Acquiring lock "cinder-3f73fa65-2646-4160-bbe2-910b9c16990a-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:35:07 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01 1G Nov 06 18:35:07 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:07 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a5c580f-f60c-4e99-ad74-c17f5d1b4ec8 tempest-ServersNegativeTestJSON-1158089865 None] Lock "cinder-3f73fa65-2646-4160-bbe2-910b9c16990a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:35:07 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a5c580f-f60c-4e99-ad74-c17f5d1b4ec8 tempest-ServersNegativeTestJSON-1158089865 None] Acquiring lock "cinder-quobyte-3f73fa65-2646-4160-bbe2-910b9c16990a" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:35:07 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a5c580f-f60c-4e99-ad74-c17f5d1b4ec8 tempest-ServersNegativeTestJSON-1158089865 None] Lock "cinder-quobyte-3f73fa65-2646-4160-bbe2-910b9c16990a" acquired by "delete_volume" :: waited 0.032s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:35:07 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe09869-3263-4eb0-8f48-d05595a52038]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:35:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a5c580f-f60c-4e99-ad74-c17f5d1b4ec8 tempest-ServersNegativeTestJSON-1158089865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3f73fa65-2646-4160-bbe2-910b9c16990a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:07 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3f73fa65-2646-4160-bbe2-910b9c16990a Nov 06 18:35:07 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:07 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01 1G" returned: 0 in 0.630s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9566b13-1bff-4a31-8249-71f98c17fb96 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:07 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9566b13-1bff-4a31-8249-71f98c17fb96 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01 Nov 06 18:35:07 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:07 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a5c580f-f60c-4e99-ad74-c17f5d1b4ec8 tempest-ServersNegativeTestJSON-1158089865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3f73fa65-2646-4160-bbe2-910b9c16990a" returned: 0 in 0.537s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a5c580f-f60c-4e99-ad74-c17f5d1b4ec8 tempest-ServersNegativeTestJSON-1158089865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3f73fa65-2646-4160-bbe2-910b9c16990a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:07 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3f73fa65-2646-4160-bbe2-910b9c16990a Nov 06 18:35:07 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:08 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9566b13-1bff-4a31-8249-71f98c17fb96 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01" returned: 0 in 0.465s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:08 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 18:35:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:08 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01 Nov 06 18:35:08 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:08 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a5c580f-f60c-4e99-ad74-c17f5d1b4ec8 tempest-ServersNegativeTestJSON-1158089865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3f73fa65-2646-4160-bbe2-910b9c16990a" returned: 0 in 0.488s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a5c580f-f60c-4e99-ad74-c17f5d1b4ec8 tempest-ServersNegativeTestJSON-1158089865 None] Lock "cinder-quobyte-3f73fa65-2646-4160-bbe2-910b9c16990a" released by "delete_volume" :: held 1.094s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:35:08 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-6a5c580f-f60c-4e99-ad74-c17f5d1b4ec8 tempest-ServersNegativeTestJSON-1158089865 None] Created reservations ['0cc11dfa-acea-495a-b98d-172b7ac01c8d', '7aa9cb15-465e-405e-bfc5-7cb42b5caec8', 'bef9cd77-6f66-4c89-8308-edb8f113b8d6', 'a0539f86-5ed6-4664-94e7-0a87b835041b'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:35:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6a5c580f-f60c-4e99-ad74-c17f5d1b4ec8 tempest-ServersNegativeTestJSON-1158089865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:35:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6a5c580f-f60c-4e99-ad74-c17f5d1b4ec8 tempest-ServersNegativeTestJSON-1158089865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:35:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6a5c580f-f60c-4e99-ad74-c17f5d1b4ec8 tempest-ServersNegativeTestJSON-1158089865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:35:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6a5c580f-f60c-4e99-ad74-c17f5d1b4ec8 tempest-ServersNegativeTestJSON-1158089865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:35:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6a5c580f-f60c-4e99-ad74-c17f5d1b4ec8 tempest-ServersNegativeTestJSON-1158089865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:35:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a5c580f-f60c-4e99-ad74-c17f5d1b4ec8 tempest-ServersNegativeTestJSON-1158089865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:08 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:35:08 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:08 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01" returned: 0 in 0.384s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:08 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.info Nov 06 18:35:08 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:08 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a5c580f-f60c-4e99-ad74-c17f5d1b4ec8 tempest-ServersNegativeTestJSON-1158089865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.323s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:08 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-6a5c580f-f60c-4e99-ad74-c17f5d1b4ec8 tempest-ServersNegativeTestJSON-1158089865 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:35:08 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-6a5c580f-f60c-4e99-ad74-c17f5d1b4ec8 tempest-ServersNegativeTestJSON-1158089865 None] Deleted volume successfully. Nov 06 18:35:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a5c580f-f60c-4e99-ad74-c17f5d1b4ec8 tempest-ServersNegativeTestJSON-1158089865 None] Lock "cinder-3f73fa65-2646-4160-bbe2-910b9c16990a-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:35:08 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.info" returned: 0 in 0.329s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:08 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 18:35:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:08 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.info Nov 06 18:35:08 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:09 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.info" returned: 0 in 0.251s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Acquiring lock "cinder-quobyte-a7d29496-5f52-454d-bd6d-a9c1638ac7f7" by "_copy_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:35:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Lock "cinder-quobyte-a7d29496-5f52-454d-bd6d-a9c1638ac7f7" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:35:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] snapshot: e0845e93-3971-43f0-ae90-0acacb25ae01, volume: a7d29496-5f52-454d-bd6d-a9c1638ac7f7, {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 18:35:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:35:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:35:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:35:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:35:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:35:09 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[775c709c-cc76-401e-9c31-20dcddf11d61]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:35:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:09 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01 Nov 06 18:35:09 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:09 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01" returned: 0 in 0.510s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9566b13-1bff-4a31-8249-71f98c17fb96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:35:09 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7280188-2bc5-4abe-bb79-e779f2e603e1]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:35:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:09 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96 Nov 06 18:35:09 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:10 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96" returned: 0 in 0.601s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96 {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 18:35:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Creating direct copy from snapshot {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 18:35:10 devstack cinder-volume[86794]: DEBUG cinder.utils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Path /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a7d29496-5f52-454d-bd6d-a9c1638ac7f7 not found in is_blk_device check {{(pid=86794) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 18:35:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a7d29496-5f52-454d-bd6d-a9c1638ac7f7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:10 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a7d29496-5f52-454d-bd6d-a9c1638ac7f7 Nov 06 18:35:10 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:15 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-217ee843-8cb0-475c-b2b1-42b91b0ac7d0 req-25b49cf3-736f-43ca-a81b-c85e00b1d695 tempest-ServerActionsTestOtherA-253261060 None] Terminate volume connection completed successfully. Nov 06 18:35:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-217ee843-8cb0-475c-b2b1-42b91b0ac7d0 req-25b49cf3-736f-43ca-a81b-c85e00b1d695 tempest-ServerActionsTestOtherA-253261060 None] Deleting attachment 81db69cc-9c2a-47ce-b665-c02f1e056b8b. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:35:18 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:UPDATE=30,cinder:SELECT=22,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:35:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a7d29496-5f52-454d-bd6d-a9c1638ac7f7" returned: 0 in 9.743s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:20 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96, size 1024.00 MB, duration 9.74 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a7d29496-5f52-454d-bd6d-a9c1638ac7f7 {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:35:20 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Converted 1024.00 MB image at 105.09 MB/s Nov 06 18:35:20 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a7d29496-5f52-454d-bd6d-a9c1638ac7f7 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 18:35:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a7d29496-5f52-454d-bd6d-a9c1638ac7f7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:20 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a7d29496-5f52-454d-bd6d-a9c1638ac7f7 Nov 06 18:35:20 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:20 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a7d29496-5f52-454d-bd6d-a9c1638ac7f7" returned: 0 in 0.275s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Lock "cinder-quobyte-a7d29496-5f52-454d-bd6d-a9c1638ac7f7" released by "_copy_volume_from_snapshot" :: held 11.262s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:35:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Acquiring lock "cinder-quobyte-e0845e93-3971-43f0-ae90-0acacb25ae01" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:35:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Lock "cinder-quobyte-e0845e93-3971-43f0-ae90-0acacb25ae01" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:35:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Deleting offline snapshot e0845e93-3971-43f0-ae90-0acacb25ae01 of volume e9566b13-1bff-4a31-8249-71f98c17fb96 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:35:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] snapshot_file for this snap is: volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:35:20 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee11197b-781b-4813-84ae-2ef8a5a0b760]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:35:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:20 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01 Nov 06 18:35:20 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:20 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01" returned: 0 in 0.479s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9566b13-1bff-4a31-8249-71f98c17fb96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:35:21 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ea82db-b4d3-4f99-bb0c-da3fc82ed0e5]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:35:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:21 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96 Nov 06 18:35:21 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:21 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96" returned: 0 in 0.601s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:21 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01 Nov 06 18:35:21 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:22 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01" returned: 0 in 0.426s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:22 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01 Nov 06 18:35:22 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:22 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96.e0845e93-3971-43f0-ae90-0acacb25ae01" returned: 0 in 0.382s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Lock "cinder-quobyte-e0845e93-3971-43f0-ae90-0acacb25ae01" released by "_delete_snapshot" :: held 2.043s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:35:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.242s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:35:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-662b242c-0270-454f-918e-00bfa7134452 tempest-GroupsV314Test-72644694 None] Create group from source-group-84f6e7b4-b120-4659-bb2c-49614440d7a3 completed successfully. Nov 06 18:35:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-92bdbcf5-63e5-4f6e-9e00-5dfa4a340043 tempest-GroupsV314Test-72644694 None] Acquiring lock "cinder-quobyte-a7d29496-5f52-454d-bd6d-a9c1638ac7f7" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:35:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-92bdbcf5-63e5-4f6e-9e00-5dfa4a340043 tempest-GroupsV314Test-72644694 None] Lock "cinder-quobyte-a7d29496-5f52-454d-bd6d-a9c1638ac7f7" acquired by "delete_volume" :: waited 0.037s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:35:23 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[618acc4c-2006-45e7-90fe-d1df4bedb7d0]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:35:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-92bdbcf5-63e5-4f6e-9e00-5dfa4a340043 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a7d29496-5f52-454d-bd6d-a9c1638ac7f7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:24 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a7d29496-5f52-454d-bd6d-a9c1638ac7f7 Nov 06 18:35:24 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:24 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-92bdbcf5-63e5-4f6e-9e00-5dfa4a340043 tempest-GroupsV314Test-72644694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a7d29496-5f52-454d-bd6d-a9c1638ac7f7" returned: 0 in 0.640s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-92bdbcf5-63e5-4f6e-9e00-5dfa4a340043 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a7d29496-5f52-454d-bd6d-a9c1638ac7f7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:24 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a7d29496-5f52-454d-bd6d-a9c1638ac7f7 Nov 06 18:35:24 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:24 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-92bdbcf5-63e5-4f6e-9e00-5dfa4a340043 tempest-GroupsV314Test-72644694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a7d29496-5f52-454d-bd6d-a9c1638ac7f7" returned: 0 in 0.316s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:24 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-92bdbcf5-63e5-4f6e-9e00-5dfa4a340043 tempest-GroupsV314Test-72644694 None] Lock "cinder-quobyte-a7d29496-5f52-454d-bd6d-a9c1638ac7f7" released by "delete_volume" :: held 1.029s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:35:25 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-92bdbcf5-63e5-4f6e-9e00-5dfa4a340043 tempest-GroupsV314Test-72644694 None] Created reservations ['7e658e95-c936-41a1-a924-0ef8e3c1c29e'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:35:25 devstack cinder-volume[86794]: WARNING cinder.quota [None req-92bdbcf5-63e5-4f6e-9e00-5dfa4a340043 tempest-GroupsV314Test-72644694 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-795340705 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-795340705, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:35:25 devstack cinder-volume[86794]: WARNING cinder.quota [None req-92bdbcf5-63e5-4f6e-9e00-5dfa4a340043 tempest-GroupsV314Test-72644694 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-795340705 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-795340705, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:35:25 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-92bdbcf5-63e5-4f6e-9e00-5dfa4a340043 tempest-GroupsV314Test-72644694 None] Created reservations ['7e90f841-f08c-4a0e-833a-46e8d47ad115', 'cd35c4d7-30cf-4bba-8cc3-31d0fbe6e04f', '088aa8f3-75c2-4a27-aa53-b6a286b005f4', '37264e11-8c27-46e4-a82d-056a80700143'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:35:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-92bdbcf5-63e5-4f6e-9e00-5dfa4a340043 tempest-GroupsV314Test-72644694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:35:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-92bdbcf5-63e5-4f6e-9e00-5dfa4a340043 tempest-GroupsV314Test-72644694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:35:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-92bdbcf5-63e5-4f6e-9e00-5dfa4a340043 tempest-GroupsV314Test-72644694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:35:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-92bdbcf5-63e5-4f6e-9e00-5dfa4a340043 tempest-GroupsV314Test-72644694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:35:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-92bdbcf5-63e5-4f6e-9e00-5dfa4a340043 tempest-GroupsV314Test-72644694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:35:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-92bdbcf5-63e5-4f6e-9e00-5dfa4a340043 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:25 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:35:25 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:25 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-92bdbcf5-63e5-4f6e-9e00-5dfa4a340043 tempest-GroupsV314Test-72644694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.283s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:25 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-92bdbcf5-63e5-4f6e-9e00-5dfa4a340043 tempest-GroupsV314Test-72644694 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:35:25 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-92bdbcf5-63e5-4f6e-9e00-5dfa4a340043 tempest-GroupsV314Test-72644694 None] Delete group completed successfully. Nov 06 18:35:26 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-11fdd9af-2edb-46d1-b2cb-f828d17dd029 tempest-GroupsV314Test-72644694 None] Acquiring lock "cinder-quobyte-e9566b13-1bff-4a31-8249-71f98c17fb96" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:35:26 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-11fdd9af-2edb-46d1-b2cb-f828d17dd029 tempest-GroupsV314Test-72644694 None] Lock "cinder-quobyte-e9566b13-1bff-4a31-8249-71f98c17fb96" acquired by "delete_volume" :: waited 0.024s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:35:26 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a6278f-c164-4325-a805-7038ff7fe002]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:35:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-11fdd9af-2edb-46d1-b2cb-f828d17dd029 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:26 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96 Nov 06 18:35:26 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:27 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-11fdd9af-2edb-46d1-b2cb-f828d17dd029 tempest-GroupsV314Test-72644694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96" returned: 0 in 0.450s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-11fdd9af-2edb-46d1-b2cb-f828d17dd029 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:27 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96 Nov 06 18:35:27 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:27 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-11fdd9af-2edb-46d1-b2cb-f828d17dd029 tempest-GroupsV314Test-72644694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e9566b13-1bff-4a31-8249-71f98c17fb96" returned: 0 in 0.334s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-11fdd9af-2edb-46d1-b2cb-f828d17dd029 tempest-GroupsV314Test-72644694 None] Lock "cinder-quobyte-e9566b13-1bff-4a31-8249-71f98c17fb96" released by "delete_volume" :: held 0.925s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Flow 'volume_create_manager' (cbccf952-e0d1-46db-b511-60c57fca09fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e882bb-c6fe-4fd0-84f5-2c52dcfa8523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-11fdd9af-2edb-46d1-b2cb-f828d17dd029 tempest-GroupsV314Test-72644694 None] Created reservations ['460057bd-7de5-49a6-800f-b8cd1065729e'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e882bb-c6fe-4fd0-84f5-2c52dcfa8523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1383410431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66bd5926-d057-4dde-9709-409f5c46f5f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab252a0c671e4f33a583b1a562d71bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:35:28Z,use_quota=True,user_id='ba85e58c46af4361ad9a599266c0ff53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4178f585-a99d-4009-b8ac-04b26560788b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4178f585-a99d-4009-b8ac-04b26560788b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d85c556-7a4a-4677-9463-e0005bd8c590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d85c556-7a4a-4677-9463-e0005bd8c590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66bd5926-d057-4dde-9709-409f5c46f5f5', 'volume_name': 'volume-66bd5926-d057-4dde-9709-409f5c46f5f5', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4244e65a-2a59-4d1e-b63d-e66847af0b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4244e65a-2a59-4d1e-b63d-e66847af0b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1033cdf-b371-4a96-a21c-1dc6c9f706a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:27 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Volume 66bd5926-d057-4dde-9709-409f5c46f5f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66bd5926-d057-4dde-9709-409f5c46f5f5', 'volume_size': 1} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1383410431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66bd5926-d057-4dde-9709-409f5c46f5f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab252a0c671e4f33a583b1a562d71bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:35:28Z,use_quota=True,user_id='ba85e58c46af4361ad9a599266c0ff53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Creating volume 66bd5926-d057-4dde-9709-409f5c46f5f5 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:35:27 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-66bd5926-d057-4dde-9709-409f5c46f5f5 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:27 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-66bd5926-d057-4dde-9709-409f5c46f5f5 1073741824 Nov 06 18:35:27 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-11fdd9af-2edb-46d1-b2cb-f828d17dd029 tempest-GroupsV314Test-72644694 None] Created reservations ['7b213ad5-6801-4a2e-96d5-f55696629a9f', '8ed24718-ddb9-420f-820a-f24e57c4eeb8', '7d34c19d-b8a2-4835-9c01-2577a5d7e713', '6398a9f6-ac5c-4279-aba0-960bd9b16fc1'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-11fdd9af-2edb-46d1-b2cb-f828d17dd029 tempest-GroupsV314Test-72644694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-11fdd9af-2edb-46d1-b2cb-f828d17dd029 tempest-GroupsV314Test-72644694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-11fdd9af-2edb-46d1-b2cb-f828d17dd029 tempest-GroupsV314Test-72644694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-11fdd9af-2edb-46d1-b2cb-f828d17dd029 tempest-GroupsV314Test-72644694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-11fdd9af-2edb-46d1-b2cb-f828d17dd029 tempest-GroupsV314Test-72644694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:35:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-11fdd9af-2edb-46d1-b2cb-f828d17dd029 tempest-GroupsV314Test-72644694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:28 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:35:28 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:28 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-11fdd9af-2edb-46d1-b2cb-f828d17dd029 tempest-GroupsV314Test-72644694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.289s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:28 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-11fdd9af-2edb-46d1-b2cb-f828d17dd029 tempest-GroupsV314Test-72644694 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:35:28 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-11fdd9af-2edb-46d1-b2cb-f828d17dd029 tempest-GroupsV314Test-72644694 None] Delete group completed successfully. Nov 06 18:35:28 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-66bd5926-d057-4dde-9709-409f5c46f5f5 1073741824" returned: 0 in 0.591s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-66bd5926-d057-4dde-9709-409f5c46f5f5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:28 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-66bd5926-d057-4dde-9709-409f5c46f5f5 Nov 06 18:35:28 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:28 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-66bd5926-d057-4dde-9709-409f5c46f5f5" returned: 0 in 0.287s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:35:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:35:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1033cdf-b371-4a96-a21c-1dc6c9f706a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66bd5926-d057-4dde-9709-409f5c46f5f5', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4227180e-20e1-4684-b382-34c523178d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:28 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Volume volume-66bd5926-d057-4dde-9709-409f5c46f5f5 (66bd5926-d057-4dde-9709-409f5c46f5f5): created successfully Nov 06 18:35:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4227180e-20e1-4684-b382-34c523178d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Flow 'volume_create_manager' (cbccf952-e0d1-46db-b511-60c57fca09fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:35:28 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-649e46e9-09e1-48ea-81da-8be60f3cd423 tempest-TaggedAttachmentsTest-2023531900 None] Created volume successfully. Nov 06 18:35:28 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:35:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Flow 'volume_create_manager' (f7dcdadb-e6f7-4474-b639-3337b2a06103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:35:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d09364-8db1-4027-b801-c2cbb9442e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d09364-8db1-4027-b801-c2cbb9442e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-779362606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89caecd7-4fd9-4aab-8b30-64c79634d8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c60eee55d1b740a4ac82bf0c3cb9e262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:35:29Z,use_quota=True,user_id='19b6f6ee364f4ca9b2328336a94f7898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc3a28c-893d-4cf6-963f-736eaea174f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc3a28c-893d-4cf6-963f-736eaea174f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f92544-440d-4eb1-a227-ffa8144de70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:28 devstack cinder-volume[86794]: DEBUG cinder.image.glance [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Creating Keystone auth plugin from conf {{(pid=86794) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 18:35:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:35:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:35:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:35:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:35:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:35:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:35:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:29 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:35:29 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:29 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.355s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:35:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f92544-440d-4eb1-a227-ffa8144de70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '89caecd7-4fd9-4aab-8b30-64c79634d8c5', 'volume_name': 'volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5', 'volume_size': 1, 'image_id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d57c6da8e464b1a80cefabe6e3cfecd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'created_at': datetime.datetime(2026, 11, 6, 17, 27, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 27, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a6bed7-96af-4b2c-8b26-8466ad9a141c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a6bed7-96af-4b2c-8b26-8466ad9a141c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ac8e82-3c05-4627-80fd-adaf71dbe5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:30 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Volume 89caecd7-4fd9-4aab-8b30-64c79634d8c5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5', 'volume_size': 1, 'image_id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d57c6da8e464b1a80cefabe6e3cfecd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'created_at': datetime.datetime(2026, 11, 6, 17, 27, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 27, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 18:35:30 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Trying to clone 89caecd7-4fd9-4aab-8b30-64c79634d8c5 from image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}]). {{(pid=86794) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 18:35:30 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_8nvr84xpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 18:35:30 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Image download 20.69 MB at 20.69 MB/s Nov 06 18:35:30 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a844a99f-5a2c-4b6c-91d0-fbcbe703340d]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:35:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_8nvr84xpdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:30 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_8nvr84xpdevstack@QuobyteHD Nov 06 18:35:30 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:30 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_8nvr84xpdevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:30 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Temporary image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 is fetched for user 19b6f6ee364f4ca9b2328336a94f7898. {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 18:35:36 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c022ba-d92f-4887-88ce-94a623f198aa]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:35:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_8nvr84xpdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:36 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_8nvr84xpdevstack@QuobyteHD Nov 06 18:35:36 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:36 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_8nvr84xpdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:35:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:35:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-779362606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89caecd7-4fd9-4aab-8b30-64c79634d8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c60eee55d1b740a4ac82bf0c3cb9e262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:35:29Z,use_quota=True,user_id='19b6f6ee364f4ca9b2328336a94f7898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:35:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Creating volume 89caecd7-4fd9-4aab-8b30-64c79634d8c5 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:35:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:35:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:35:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:35:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:35:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:35:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:35:36 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:35:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:36 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5 1073741824 Nov 06 18:35:36 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:37 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5 1073741824" returned: 0 in 0.567s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:37 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5 Nov 06 18:35:37 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:37 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5" returned: 0 in 0.306s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:35:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:35:37 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Attempting download of 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}])) to volume 89caecd7-4fd9-4aab-8b30-64c79634d8c5. {{(pid=86794) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 18:35:37 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4937aab-2fa6-4d9f-889f-0ac3b4ac7dbd]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:35:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_t1y9fuvb {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:37 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_t1y9fuvb Nov 06 18:35:37 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:38 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_t1y9fuvb" returned: 0 in 0.372s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_t1y9fuvb {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:38 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_t1y9fuvb Nov 06 18:35:38 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:38 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_t1y9fuvb" returned: 1 in 0.403s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_t1y9fuvb' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:35:38 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a22faa7-1e56-46ef-b3e1-cc5a9b23c922]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:35:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_8nvr84xpdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:38 devstack sudo[90700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_8nvr84xpdevstack@QuobyteHD Nov 06 18:35:38 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:39 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_8nvr84xpdevstack@QuobyteHD" returned: 0 in 0.510s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:39 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 was qcow2, converting to qcow2 {{(pid=86794) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 18:35:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_8nvr84xpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:39 devstack sudo[90706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_8nvr84xpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5 Nov 06 18:35:39 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:42 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_8nvr84xpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5" returned: 0 in 2.938s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:42 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_8nvr84xpdevstack@QuobyteHD, size 112.00 MB, duration 2.94 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5 {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:35:42 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Converted 112.00 MB image at 38.10 MB/s Nov 06 18:35:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:42 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5 1G Nov 06 18:35:42 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:42 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5 1G" returned: 0 in 0.663s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:42 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Downloaded image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}])) to volume 89caecd7-4fd9-4aab-8b30-64c79634d8c5 successfully. {{(pid=86794) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 18:35:42 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Temporary image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 for user 19b6f6ee364f4ca9b2328336a94f7898 is deleted. {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 18:35:42 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Marking volume 89caecd7-4fd9-4aab-8b30-64c79634d8c5 as bootable. {{(pid=86794) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 18:35:42 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Copying metadata from image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 to 89caecd7-4fd9-4aab-8b30-64c79634d8c5. {{(pid=86794) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 18:35:42 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Creating volume glance metadata for volume 89caecd7-4fd9-4aab-8b30-64c79634d8c5 backed by image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86794) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 18:35:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ac8e82-3c05-4627-80fd-adaf71dbe5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5', 'volume_size': 1, 'image_id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d57c6da8e464b1a80cefabe6e3cfecd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'created_at': datetime.datetime(2026, 11, 6, 17, 27, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 27, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25c14ab-8478-41a3-9ca4-7bfbc6bcca16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:42 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Volume volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5 (89caecd7-4fd9-4aab-8b30-64c79634d8c5): created successfully Nov 06 18:35:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25c14ab-8478-41a3-9ca4-7bfbc6bcca16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Flow 'volume_create_manager' (f7dcdadb-e6f7-4474-b639-3337b2a06103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:35:42 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-3ec8190c-55dd-46a0-9ed6-f716cc267b64 tempest-ServerActionsTestOtherA-253261060 None] Created volume successfully. Nov 06 18:35:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-40b29e8b-1ace-46df-8207-e02e6df5ff6a req-dd1cda6e-f6b9-4f78-a62e-20a6ad07b2b8 tempest-ServerActionsTestOtherA-253261060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:35:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-40b29e8b-1ace-46df-8207-e02e6df5ff6a req-dd1cda6e-f6b9-4f78-a62e-20a6ad07b2b8 tempest-ServerActionsTestOtherA-253261060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:35:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-40b29e8b-1ace-46df-8207-e02e6df5ff6a req-dd1cda6e-f6b9-4f78-a62e-20a6ad07b2b8 tempest-ServerActionsTestOtherA-253261060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:35:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-40b29e8b-1ace-46df-8207-e02e6df5ff6a req-dd1cda6e-f6b9-4f78-a62e-20a6ad07b2b8 tempest-ServerActionsTestOtherA-253261060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26c58b5b-5580-42e2-996e-54e5d1d79e4f', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:35:49 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-40b29e8b-1ace-46df-8207-e02e6df5ff6a req-dd1cda6e-f6b9-4f78-a62e-20a6ad07b2b8 tempest-ServerActionsTestOtherA-253261060 None] attachment_update completed successfully. Nov 06 18:35:58 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=60,cinder:UPDATE=59,cinder:DELETE=2,cinder:INSERT=22 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Flow 'volume_create_manager' (f581c2fd-79b0-4688-919b-04f985bd32cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9619cd7a-5d44-440d-85cc-13d62455d49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9619cd7a-5d44-440d-85cc-13d62455d49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-267764317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3ff861-240b-43de-b8a4-8d96a6d1b4de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c540998132cd479fbaef914eb769408e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:35:59Z,use_quota=True,user_id='cd1ac783bf454fb08efbd4606fb823fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9526e860-ec2a-4882-a062-3322f3333cb4),volume_type_id=9526e860-ec2a-4882-a062-3322f3333cb4)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d11086e-d655-49a3-be4f-33bbcbe39fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d11086e-d655-49a3-be4f-33bbcbe39fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49918c22-bebc-4fea-9ce3-4bf18798011a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49918c22-bebc-4fea-9ce3-4bf18798011a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a3ff861-240b-43de-b8a4-8d96a6d1b4de', 'volume_name': 'volume-9a3ff861-240b-43de-b8a4-8d96a6d1b4de', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d8ecfc-1029-41dc-aa29-bd71e8285039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d8ecfc-1029-41dc-aa29-bd71e8285039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc05494c-c801-4c6e-a0f1-d4b2959dab07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:35:59 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Volume 9a3ff861-240b-43de-b8a4-8d96a6d1b4de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a3ff861-240b-43de-b8a4-8d96a6d1b4de', 'volume_size': 1} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-267764317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3ff861-240b-43de-b8a4-8d96a6d1b4de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c540998132cd479fbaef914eb769408e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:35:59Z,use_quota=True,user_id='cd1ac783bf454fb08efbd4606fb823fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9526e860-ec2a-4882-a062-3322f3333cb4),volume_type_id=9526e860-ec2a-4882-a062-3322f3333cb4)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Creating volume 9a3ff861-240b-43de-b8a4-8d96a6d1b4de {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:35:59 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a3ff861-240b-43de-b8a4-8d96a6d1b4de 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:35:59 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a3ff861-240b-43de-b8a4-8d96a6d1b4de 1073741824 Nov 06 18:35:59 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:35:59 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a3ff861-240b-43de-b8a4-8d96a6d1b4de 1073741824" returned: 0 in 0.702s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:35:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a3ff861-240b-43de-b8a4-8d96a6d1b4de {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:00 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a3ff861-240b-43de-b8a4-8d96a6d1b4de Nov 06 18:36:00 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:00 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a3ff861-240b-43de-b8a4-8d96a6d1b4de" returned: 0 in 0.795s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:36:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:36:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc05494c-c801-4c6e-a0f1-d4b2959dab07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a3ff861-240b-43de-b8a4-8d96a6d1b4de', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:36:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24eabb7f-79e7-4b63-9e03-eee0cc2a4b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:36:00 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Volume volume-9a3ff861-240b-43de-b8a4-8d96a6d1b4de (9a3ff861-240b-43de-b8a4-8d96a6d1b4de): created successfully Nov 06 18:36:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24eabb7f-79e7-4b63-9e03-eee0cc2a4b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:36:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Flow 'volume_create_manager' (f581c2fd-79b0-4688-919b-04f985bd32cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:36:00 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a2e91805-7e3f-4b09-85ca-564d28ed53bc tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Created volume successfully. Nov 06 18:36:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7ecc191b-73b7-4568-8ca5-0497a6638c18 tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:36:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7ecc191b-73b7-4568-8ca5-0497a6638c18 tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:36:01 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7ecc191b-73b7-4568-8ca5-0497a6638c18 tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:36:01 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7ecc191b-73b7-4568-8ca5-0497a6638c18 tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:36:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7ecc191b-73b7-4568-8ca5-0497a6638c18 tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:36:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7ecc191b-73b7-4568-8ca5-0497a6638c18 tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:02 devstack sudo[91356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:36:02 devstack sudo[91356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:02 devstack sudo[91356]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7ecc191b-73b7-4568-8ca5-0497a6638c18 tempest-VolumeRetypeWithoutMigrationTest-603303043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.473s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:02 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-7ecc191b-73b7-4568-8ca5-0497a6638c18 tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:36:02 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-7ecc191b-73b7-4568-8ca5-0497a6638c18 tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Retype volume completed successfully. Nov 06 18:36:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Acquiring lock "cinder-9a3ff861-240b-43de-b8a4-8d96a6d1b4de-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:36:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Lock "cinder-9a3ff861-240b-43de-b8a4-8d96a6d1b4de-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:36:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Acquiring lock "cinder-quobyte-9a3ff861-240b-43de-b8a4-8d96a6d1b4de" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:36:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Lock "cinder-quobyte-9a3ff861-240b-43de-b8a4-8d96a6d1b4de" acquired by "delete_volume" :: waited 0.077s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:36:03 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74a848c-3a5a-42fa-acee-1ed8a65d1c03]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:36:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a3ff861-240b-43de-b8a4-8d96a6d1b4de {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:03 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a3ff861-240b-43de-b8a4-8d96a6d1b4de Nov 06 18:36:03 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:04 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a3ff861-240b-43de-b8a4-8d96a6d1b4de" returned: 0 in 0.586s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a3ff861-240b-43de-b8a4-8d96a6d1b4de {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:04 devstack sudo[91369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a3ff861-240b-43de-b8a4-8d96a6d1b4de Nov 06 18:36:04 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:04 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9a3ff861-240b-43de-b8a4-8d96a6d1b4de" returned: 0 in 0.369s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:04 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Lock "cinder-quobyte-9a3ff861-240b-43de-b8a4-8d96a6d1b4de" released by "delete_volume" :: held 1.061s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:36:04 devstack cinder-volume[86794]: WARNING cinder.quota [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:36:04 devstack cinder-volume[86794]: WARNING cinder.quota [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:36:04 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Created reservations ['029589d2-10c9-4c6a-9cb6-14be54426fc4', '93e794d2-febf-4c70-9fdb-b253e8bd59ad', 'c7daed8a-e866-4c76-940d-2ef9c1dd1006', 'e82d4ea4-28e3-4f5a-85f8-20404c224e9d'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:36:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:36:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:36:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:36:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:36:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:36:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:05 devstack sudo[91387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:36:05 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:05 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.504s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:05 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:36:05 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Deleted volume successfully. Nov 06 18:36:05 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3bd002b0-1b0e-4037-a2c2-043f791eda4f tempest-VolumeRetypeWithoutMigrationTest-603303043 None] Lock "cinder-9a3ff861-240b-43de-b8a4-8d96a6d1b4de-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:36:15 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:UPDATE=48,cinder:SELECT=53,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:36:15 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:UPDATE=14,cinder:SELECT=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:36:16 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-9271495e-abc1-4913-95ae-74ebf98ca1eb req-726f6fe5-68bf-43b8-9e16-6715c2d52b3f tempest-ServerActionsTestOtherA-253261060 None] Terminate volume connection completed successfully. Nov 06 18:36:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-9271495e-abc1-4913-95ae-74ebf98ca1eb req-726f6fe5-68bf-43b8-9e16-6715c2d52b3f tempest-ServerActionsTestOtherA-253261060 None] Deleting attachment 26c58b5b-5580-42e2-996e-54e5d1d79e4f. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-9271495e-abc1-4913-95ae-74ebf98ca1eb req-c9ea174d-cf36-4c61-9ab7-ca052aaa7072 tempest-ServerActionsTestOtherA-253261060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-9271495e-abc1-4913-95ae-74ebf98ca1eb req-c9ea174d-cf36-4c61-9ab7-ca052aaa7072 tempest-ServerActionsTestOtherA-253261060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-9271495e-abc1-4913-95ae-74ebf98ca1eb req-c9ea174d-cf36-4c61-9ab7-ca052aaa7072 tempest-ServerActionsTestOtherA-253261060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-9271495e-abc1-4913-95ae-74ebf98ca1eb req-c9ea174d-cf36-4c61-9ab7-ca052aaa7072 tempest-ServerActionsTestOtherA-253261060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a7c366d-8b8b-46fd-82ff-11e666695c83', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:36:19 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-9271495e-abc1-4913-95ae-74ebf98ca1eb req-c9ea174d-cf36-4c61-9ab7-ca052aaa7072 tempest-ServerActionsTestOtherA-253261060 None] attachment_update completed successfully. Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Flow 'volume_create_manager' (175e8a36-aad3-49a7-bc51-76d811d8f97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2b1478-40ca-44ce-a1d6-ed838a853cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2b1478-40ca-44ce-a1d6-ed838a853cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-853191936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408cb962-0080-4484-95c3-bd0843729b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00cd3bf0f2004d7f8892a3d0d61ed5e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:36:20Z,use_quota=True,user_id='8f82b111a66f475b9cc1dac40fde5668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c63d52-4e89-49c1-bf36-198d31d95f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c63d52-4e89-49c1-bf36-198d31d95f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daabdc16-14aa-4ab4-9bb8-0b314bf1b9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daabdc16-14aa-4ab4-9bb8-0b314bf1b9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '408cb962-0080-4484-95c3-bd0843729b68', 'volume_name': 'volume-408cb962-0080-4484-95c3-bd0843729b68', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f5876a-f283-41a4-97aa-e7a2578e3982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f5876a-f283-41a4-97aa-e7a2578e3982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e28e39-a938-4e1f-9cb7-f2b7b203d2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:36:19 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Volume 408cb962-0080-4484-95c3-bd0843729b68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-408cb962-0080-4484-95c3-bd0843729b68', 'volume_size': 1} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-853191936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408cb962-0080-4484-95c3-bd0843729b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00cd3bf0f2004d7f8892a3d0d61ed5e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:36:20Z,use_quota=True,user_id='8f82b111a66f475b9cc1dac40fde5668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Creating volume 408cb962-0080-4484-95c3-bd0843729b68 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:36:19 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:36:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:19 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68 1073741824 Nov 06 18:36:19 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:20 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68 1073741824" returned: 0 in 0.981s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:21 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68 Nov 06 18:36:21 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:21 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68" returned: 0 in 0.551s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:36:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:36:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e28e39-a938-4e1f-9cb7-f2b7b203d2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-408cb962-0080-4484-95c3-bd0843729b68', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:36:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa21041-bf5c-40de-ac82-451bf057a16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:36:21 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Volume volume-408cb962-0080-4484-95c3-bd0843729b68 (408cb962-0080-4484-95c3-bd0843729b68): created successfully Nov 06 18:36:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa21041-bf5c-40de-ac82-451bf057a16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:36:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Flow 'volume_create_manager' (175e8a36-aad3-49a7-bc51-76d811d8f97e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:36:21 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-b358cc83-d579-4b4c-9725-260f105e8d47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Created volume successfully. Nov 06 18:36:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bde8bd53-a04a-48a3-9b48-734d1c3b7f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:36:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bde8bd53-a04a-48a3-9b48-734d1c3b7f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:36:22 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-bde8bd53-a04a-48a3-9b48-734d1c3b7f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Creating offline snapshot 36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9 of volume 408cb962-0080-4484-95c3-bd0843729b68 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:36:22 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[5952d816-c6b3-416e-820a-a14d1e6ef6ad]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:36:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bde8bd53-a04a-48a3-9b48-734d1c3b7f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:22 devstack sudo[92055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68 Nov 06 18:36:22 devstack sudo[92055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:23 devstack sudo[92055]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bde8bd53-a04a-48a3-9b48-734d1c3b7f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68" returned: 0 in 0.806s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bde8bd53-a04a-48a3-9b48-734d1c3b7f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:23 devstack sudo[92091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9 1G Nov 06 18:36:23 devstack sudo[92091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:24 devstack sudo[92091]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bde8bd53-a04a-48a3-9b48-734d1c3b7f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9 1G" returned: 0 in 1.108s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bde8bd53-a04a-48a3-9b48-734d1c3b7f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-408cb962-0080-4484-95c3-bd0843729b68 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:24 devstack sudo[92121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-408cb962-0080-4484-95c3-bd0843729b68 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9 Nov 06 18:36:24 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:24 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bde8bd53-a04a-48a3-9b48-734d1c3b7f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-408cb962-0080-4484-95c3-bd0843729b68 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9" returned: 0 in 0.466s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:24 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-bde8bd53-a04a-48a3-9b48-734d1c3b7f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9 is being set with open permissions: ugo+rw Nov 06 18:36:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bde8bd53-a04a-48a3-9b48-734d1c3b7f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:24 devstack sudo[92127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9 Nov 06 18:36:24 devstack sudo[92127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:25 devstack sudo[92127]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bde8bd53-a04a-48a3-9b48-734d1c3b7f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9" returned: 0 in 0.434s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bde8bd53-a04a-48a3-9b48-734d1c3b7f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:25 devstack sudo[92132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.info Nov 06 18:36:25 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:25 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bde8bd53-a04a-48a3-9b48-734d1c3b7f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.info" returned: 0 in 0.382s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:25 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-bde8bd53-a04a-48a3-9b48-734d1c3b7f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.info is being set with open permissions: ugo+rw Nov 06 18:36:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bde8bd53-a04a-48a3-9b48-734d1c3b7f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:25 devstack sudo[92143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.info Nov 06 18:36:25 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-2ed81ff0-6c47-4d44-92d8-9b4be8ea57c9 req-417fa140-bbb3-4577-9df1-fb1b8f645e9e tempest-TaggedAttachmentsTest-2023531900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:36:25 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bde8bd53-a04a-48a3-9b48-734d1c3b7f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.info" returned: 0 in 0.334s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bde8bd53-a04a-48a3-9b48-734d1c3b7f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.734s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:36:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-2ed81ff0-6c47-4d44-92d8-9b4be8ea57c9 req-417fa140-bbb3-4577-9df1-fb1b8f645e9e tempest-TaggedAttachmentsTest-2023531900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.198s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:36:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-2ed81ff0-6c47-4d44-92d8-9b4be8ea57c9 req-417fa140-bbb3-4577-9df1-fb1b8f645e9e tempest-TaggedAttachmentsTest-2023531900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:36:25 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-bde8bd53-a04a-48a3-9b48-734d1c3b7f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Create snapshot completed successfully Nov 06 18:36:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-2ed81ff0-6c47-4d44-92d8-9b4be8ea57c9 req-417fa140-bbb3-4577-9df1-fb1b8f645e9e tempest-TaggedAttachmentsTest-2023531900 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-66bd5926-d057-4dde-9709-409f5c46f5f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53f24e82-b8b5-4766-99cd-4f1010d2bda3', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:36:26 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-2ed81ff0-6c47-4d44-92d8-9b4be8ea57c9 req-417fa140-bbb3-4577-9df1-fb1b8f645e9e tempest-TaggedAttachmentsTest-2023531900 None] attachment_update completed successfully. Nov 06 18:36:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Acquiring lock "cinder-36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:36:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Lock "cinder-36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:36:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Acquiring lock "cinder-quobyte-408cb962-0080-4484-95c3-bd0843729b68" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:36:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Lock "cinder-quobyte-408cb962-0080-4484-95c3-bd0843729b68" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:36:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Acquiring lock "cinder-quobyte-36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:36:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Lock "cinder-quobyte-36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:36:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Deleting offline snapshot 36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9 of volume 408cb962-0080-4484-95c3-bd0843729b68 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:36:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] snapshot_file for this snap is: volume-408cb962-0080-4484-95c3-bd0843729b68.36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:36:27 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d13c6f-88d9-4c23-a1cc-b0ffdd9f9b3f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:36:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:27 devstack sudo[92151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9 Nov 06 18:36:27 devstack sudo[92151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:27 devstack sudo[92151]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9" returned: 0 in 0.461s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-408cb962-0080-4484-95c3-bd0843729b68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:36:27 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8af0b6-220d-4b42-88aa-6236e10cc79f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:36:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:28 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68 Nov 06 18:36:28 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:28 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68" returned: 0 in 0.531s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:28 devstack sudo[92166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9 Nov 06 18:36:28 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:28 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9" returned: 0 in 0.390s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:28 devstack sudo[92172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9 Nov 06 18:36:28 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:29 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-923a9713-664b-459f-a9fd-f92d5777553c req-65d875a7-3089-421c-bb34-0cbc695ac91f tempest-TaggedAttachmentsTest-2023531900 None] Terminate volume connection completed successfully. Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-923a9713-664b-459f-a9fd-f92d5777553c req-65d875a7-3089-421c-bb34-0cbc695ac91f tempest-TaggedAttachmentsTest-2023531900 None] Deleting attachment 53f24e82-b8b5-4766-99cd-4f1010d2bda3. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:36:29 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68.36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9" returned: 0 in 0.287s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:29 devstack sudo[92177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:36:29 devstack sudo[92177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Lock "cinder-quobyte-36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9" released by "_delete_snapshot" :: held 1.862s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Lock "cinder-quobyte-408cb962-0080-4484-95c3-bd0843729b68" released by "delete_snapshot" :: held 1.888s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:36:29 devstack cinder-volume[86794]: WARNING cinder.quota [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Created reservations ['fbce0c61-8fee-462f-a9a9-127b3466e25e', 'a43a164c-a6b5-4563-ac6c-e04e33de1a4b', 'e31ffc91-ae35-4c8b-9e94-07cb74b5746d', 'fa7cb098-8724-4cb6-95eb-fb7b9ca60490'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:36:29 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Delete snapshot completed successfully. Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-171cbb88-243f-47d4-be3c-cda6a1c96c24 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Lock "cinder-36b5f63e-da4d-492d-bb06-7b9ad0c9d3c9-delete_snapshot" released by "delete_snapshot" :: held 2.089s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:36:29 devstack sudo[92177]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.315s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 29 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-50a304f6-3973-4648-a0f2-83b60f86ddb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Acquiring lock "cinder-408cb962-0080-4484-95c3-bd0843729b68-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-50a304f6-3973-4648-a0f2-83b60f86ddb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Lock "cinder-408cb962-0080-4484-95c3-bd0843729b68-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-50a304f6-3973-4648-a0f2-83b60f86ddb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Acquiring lock "cinder-quobyte-408cb962-0080-4484-95c3-bd0843729b68" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-50a304f6-3973-4648-a0f2-83b60f86ddb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Lock "cinder-quobyte-408cb962-0080-4484-95c3-bd0843729b68" acquired by "delete_volume" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[540248b7-05dd-4950-95ab-2e2130814fab]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:36:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-50a304f6-3973-4648-a0f2-83b60f86ddb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:29 devstack sudo[92180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68 Nov 06 18:36:29 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:30 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-50a304f6-3973-4648-a0f2-83b60f86ddb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68" returned: 0 in 0.629s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-50a304f6-3973-4648-a0f2-83b60f86ddb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:30 devstack sudo[92188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68 Nov 06 18:36:30 devstack sudo[92188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:30 devstack sudo[92188]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-50a304f6-3973-4648-a0f2-83b60f86ddb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-408cb962-0080-4484-95c3-bd0843729b68" returned: 0 in 0.539s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-50a304f6-3973-4648-a0f2-83b60f86ddb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Lock "cinder-quobyte-408cb962-0080-4484-95c3-bd0843729b68" released by "delete_volume" :: held 1.278s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:36:30 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-50a304f6-3973-4648-a0f2-83b60f86ddb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Created reservations ['8faac427-921f-4530-96fe-1a4ad3b5ae19', 'ccfc6d2b-b5f1-41dc-bdea-312ff2801168', 'e58a8506-ffd9-4811-b210-f535b57557aa', 'ed311df4-0ea7-4754-b6fa-cf85d2f6cdd7'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:36:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-50a304f6-3973-4648-a0f2-83b60f86ddb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:36:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-50a304f6-3973-4648-a0f2-83b60f86ddb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:36:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-50a304f6-3973-4648-a0f2-83b60f86ddb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:36:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-50a304f6-3973-4648-a0f2-83b60f86ddb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:36:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-50a304f6-3973-4648-a0f2-83b60f86ddb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:36:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-50a304f6-3973-4648-a0f2-83b60f86ddb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:31 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:36:31 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:31 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-50a304f6-3973-4648-a0f2-83b60f86ddb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.360s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:31 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-50a304f6-3973-4648-a0f2-83b60f86ddb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:36:31 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-50a304f6-3973-4648-a0f2-83b60f86ddb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Deleted volume successfully. Nov 06 18:36:31 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-50a304f6-3973-4648-a0f2-83b60f86ddb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1854543508 None] Lock "cinder-408cb962-0080-4484-95c3-bd0843729b68-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Flow 'volume_create_manager' (94637817-4a37-4726-9782-8371d39bea8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526ca8c9-de74-4d95-8be8-9ae4c84ae063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526ca8c9-de74-4d95-8be8-9ae4c84ae063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1174167081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d53999-5d9d-4f4b-a467-991fe225d77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609d208ead68493ca2bc38289a1c67d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:36:35Z,use_quota=True,user_id='1e0018bef7e84997a74e7f010513f10e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab222b4-94df-42cb-a26b-3b6bae541803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab222b4-94df-42cb-a26b-3b6bae541803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6494fb85-2440-476d-b357-d89b85a96e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6494fb85-2440-476d-b357-d89b85a96e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68d53999-5d9d-4f4b-a467-991fe225d77c', 'volume_name': 'volume-68d53999-5d9d-4f4b-a467-991fe225d77c', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43c1a0e-a5d3-4e41-b8ed-3cb5ad126e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43c1a0e-a5d3-4e41-b8ed-3cb5ad126e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e893b7-8b5f-4bdf-b437-8da594fc332b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:36:34 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Volume 68d53999-5d9d-4f4b-a467-991fe225d77c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68d53999-5d9d-4f4b-a467-991fe225d77c', 'volume_size': 1} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1174167081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d53999-5d9d-4f4b-a467-991fe225d77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609d208ead68493ca2bc38289a1c67d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:36:35Z,use_quota=True,user_id='1e0018bef7e84997a74e7f010513f10e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Creating volume 68d53999-5d9d-4f4b-a467-991fe225d77c {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:36:34 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:36:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-68d53999-5d9d-4f4b-a467-991fe225d77c 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:35 devstack sudo[92229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-68d53999-5d9d-4f4b-a467-991fe225d77c 1073741824 Nov 06 18:36:35 devstack sudo[92229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:35 devstack sudo[92229]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-68d53999-5d9d-4f4b-a467-991fe225d77c 1073741824" returned: 0 in 0.896s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-68d53999-5d9d-4f4b-a467-991fe225d77c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:35 devstack sudo[92248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-68d53999-5d9d-4f4b-a467-991fe225d77c Nov 06 18:36:35 devstack sudo[92248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:36 devstack sudo[92248]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-68d53999-5d9d-4f4b-a467-991fe225d77c" returned: 0 in 0.400s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:36:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:36:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e893b7-8b5f-4bdf-b437-8da594fc332b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68d53999-5d9d-4f4b-a467-991fe225d77c', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:36:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba96a37e-f482-4a53-a2f6-a38e49f1babe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:36:36 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Volume volume-68d53999-5d9d-4f4b-a467-991fe225d77c (68d53999-5d9d-4f4b-a467-991fe225d77c): created successfully Nov 06 18:36:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba96a37e-f482-4a53-a2f6-a38e49f1babe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:36:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Flow 'volume_create_manager' (94637817-4a37-4726-9782-8371d39bea8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:36:36 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-ac0bcd22-e122-4cf6-a31e-27645cfe8c9c tempest-AttachVolumeShelveTestJSON-1400662468 None] Created volume successfully. Nov 06 18:36:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6779225d-9766-4e77-acf0-95c726c40f53 tempest-TaggedAttachmentsTest-2023531900 None] Acquiring lock "cinder-66bd5926-d057-4dde-9709-409f5c46f5f5-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:36:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6779225d-9766-4e77-acf0-95c726c40f53 tempest-TaggedAttachmentsTest-2023531900 None] Lock "cinder-66bd5926-d057-4dde-9709-409f5c46f5f5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:36:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6779225d-9766-4e77-acf0-95c726c40f53 tempest-TaggedAttachmentsTest-2023531900 None] Acquiring lock "cinder-quobyte-66bd5926-d057-4dde-9709-409f5c46f5f5" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:36:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6779225d-9766-4e77-acf0-95c726c40f53 tempest-TaggedAttachmentsTest-2023531900 None] Lock "cinder-quobyte-66bd5926-d057-4dde-9709-409f5c46f5f5" acquired by "delete_volume" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:36:41 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93c72d8-bc6d-46bb-b236-0d1f5511974e]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:36:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6779225d-9766-4e77-acf0-95c726c40f53 tempest-TaggedAttachmentsTest-2023531900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-66bd5926-d057-4dde-9709-409f5c46f5f5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:41 devstack sudo[92340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-66bd5926-d057-4dde-9709-409f5c46f5f5 Nov 06 18:36:41 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:41 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6779225d-9766-4e77-acf0-95c726c40f53 tempest-TaggedAttachmentsTest-2023531900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-66bd5926-d057-4dde-9709-409f5c46f5f5" returned: 0 in 0.501s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6779225d-9766-4e77-acf0-95c726c40f53 tempest-TaggedAttachmentsTest-2023531900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-66bd5926-d057-4dde-9709-409f5c46f5f5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:41 devstack sudo[92352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-66bd5926-d057-4dde-9709-409f5c46f5f5 Nov 06 18:36:41 devstack sudo[92352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:41 devstack sudo[92352]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6779225d-9766-4e77-acf0-95c726c40f53 tempest-TaggedAttachmentsTest-2023531900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-66bd5926-d057-4dde-9709-409f5c46f5f5" returned: 0 in 0.375s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6779225d-9766-4e77-acf0-95c726c40f53 tempest-TaggedAttachmentsTest-2023531900 None] Lock "cinder-quobyte-66bd5926-d057-4dde-9709-409f5c46f5f5" released by "delete_volume" :: held 0.927s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:36:42 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-6779225d-9766-4e77-acf0-95c726c40f53 tempest-TaggedAttachmentsTest-2023531900 None] Created reservations ['b3f216a2-a6a0-4df2-861a-52f0faf6b975', 'cda983e4-9d92-4b79-ab12-23df9cfa74c1', '305506fd-4236-4bf0-9bc7-5fc7fbb8f36c', '5bceea33-89e2-4d6e-a072-93980bc26a06'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:36:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6779225d-9766-4e77-acf0-95c726c40f53 tempest-TaggedAttachmentsTest-2023531900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:36:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6779225d-9766-4e77-acf0-95c726c40f53 tempest-TaggedAttachmentsTest-2023531900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:36:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6779225d-9766-4e77-acf0-95c726c40f53 tempest-TaggedAttachmentsTest-2023531900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:36:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6779225d-9766-4e77-acf0-95c726c40f53 tempest-TaggedAttachmentsTest-2023531900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:36:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6779225d-9766-4e77-acf0-95c726c40f53 tempest-TaggedAttachmentsTest-2023531900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:36:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6779225d-9766-4e77-acf0-95c726c40f53 tempest-TaggedAttachmentsTest-2023531900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:36:42 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:36:42 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:36:42 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Nov 06 18:36:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6779225d-9766-4e77-acf0-95c726c40f53 tempest-TaggedAttachmentsTest-2023531900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.273s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:36:42 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-6779225d-9766-4e77-acf0-95c726c40f53 tempest-TaggedAttachmentsTest-2023531900 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:36:42 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-6779225d-9766-4e77-acf0-95c726c40f53 tempest-TaggedAttachmentsTest-2023531900 None] Deleted volume successfully. Nov 06 18:36:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6779225d-9766-4e77-acf0-95c726c40f53 tempest-TaggedAttachmentsTest-2023531900 None] Lock "cinder-66bd5926-d057-4dde-9709-409f5c46f5f5-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:36:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-bf0b2c6d-e64e-4e13-b8bc-4b191b6a5add req-bfaf4171-0b69-4f67-86ca-16d1c05d2b55 tempest-AttachVolumeShelveTestJSON-1400662468 None] No connector for attachment b9c55637-b27f-41fc-a4f9-ebfc6d55986c; skipping storage backend terminate_connection call. {{(pid=86794) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5009}} Nov 06 18:36:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-bf0b2c6d-e64e-4e13-b8bc-4b191b6a5add req-bfaf4171-0b69-4f67-86ca-16d1c05d2b55 tempest-AttachVolumeShelveTestJSON-1400662468 None] Deleting attachment b9c55637-b27f-41fc-a4f9-ebfc6d55986c. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:36:52 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=35,cinder:UPDATE=36,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:36:58 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=44,cinder:UPDATE=29,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:36:59 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Flow 'volume_create_manager' (0378553c-3b87-443d-891b-65882b560bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab69f21a-75c4-4b6e-82b5-31225ad9cf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab69f21a-75c4-4b6e-82b5-31225ad9cf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1356956039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e4457f6-580f-44c6-bd60-ca69b9683bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fded13931e8a4d43820c6e5880e66833',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:37:00Z,use_quota=True,user_id='1551e72d2e1d45bbb3dd83793864851f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb9dd1b-040d-4ae8-a55f-eb9f26bf2180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb9dd1b-040d-4ae8-a55f-eb9f26bf2180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc684ff-ff35-498d-a3e6-4dec7a080aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc684ff-ff35-498d-a3e6-4dec7a080aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e4457f6-580f-44c6-bd60-ca69b9683bc1', 'volume_name': 'volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c6564b-dd9e-4ccb-8cab-14f2d56f898a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c6564b-dd9e-4ccb-8cab-14f2d56f898a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c557d66-c9af-46da-8230-f17a53797fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:00 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Volume 6e4457f6-580f-44c6-bd60-ca69b9683bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1', 'volume_size': 1} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1356956039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e4457f6-580f-44c6-bd60-ca69b9683bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fded13931e8a4d43820c6e5880e66833',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:37:00Z,use_quota=True,user_id='1551e72d2e1d45bbb3dd83793864851f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Creating volume 6e4457f6-580f-44c6-bd60-ca69b9683bc1 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:37:00 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:00 devstack sudo[92471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1 1073741824 Nov 06 18:37:00 devstack sudo[92471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:00 devstack sudo[92471]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1 1073741824" returned: 0 in 0.749s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:01 devstack sudo[92510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1 Nov 06 18:37:01 devstack sudo[92510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:01 devstack sudo[92510]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1" returned: 0 in 0.269s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:01 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:37:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:37:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c557d66-c9af-46da-8230-f17a53797fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c52a00-447a-4a02-9fe6-a2b4dc868d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:01 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Volume volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1 (6e4457f6-580f-44c6-bd60-ca69b9683bc1): created successfully Nov 06 18:37:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c52a00-447a-4a02-9fe6-a2b4dc868d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Flow 'volume_create_manager' (0378553c-3b87-443d-891b-65882b560bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:37:01 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-8f5c5cde-b469-4857-b520-83e1bcfaca2a tempest-SnapshotMetadataTestJSON-57750533 None] Created volume successfully. Nov 06 18:37:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-432c7617-b487-4980-ada3-748c1c4c6a97 tempest-SnapshotMetadataTestJSON-57750533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:37:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-432c7617-b487-4980-ada3-748c1c4c6a97 tempest-SnapshotMetadataTestJSON-57750533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:37:02 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-432c7617-b487-4980-ada3-748c1c4c6a97 tempest-SnapshotMetadataTestJSON-57750533 None] Creating offline snapshot 97605650-38fd-400b-add4-e68ab3df17cc of volume 6e4457f6-580f-44c6-bd60-ca69b9683bc1 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:37:02 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[209b8f8d-06b4-471e-b9b4-cdd66ca0d28a]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:37:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-432c7617-b487-4980-ada3-748c1c4c6a97 tempest-SnapshotMetadataTestJSON-57750533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:02 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1 Nov 06 18:37:02 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:02 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-432c7617-b487-4980-ada3-748c1c4c6a97 tempest-SnapshotMetadataTestJSON-57750533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1" returned: 0 in 0.539s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-432c7617-b487-4980-ada3-748c1c4c6a97 tempest-SnapshotMetadataTestJSON-57750533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.97605650-38fd-400b-add4-e68ab3df17cc 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:02 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.97605650-38fd-400b-add4-e68ab3df17cc 1G Nov 06 18:37:02 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:03 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-432c7617-b487-4980-ada3-748c1c4c6a97 tempest-SnapshotMetadataTestJSON-57750533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.97605650-38fd-400b-add4-e68ab3df17cc 1G" returned: 0 in 0.483s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-432c7617-b487-4980-ada3-748c1c4c6a97 tempest-SnapshotMetadataTestJSON-57750533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.97605650-38fd-400b-add4-e68ab3df17cc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:03 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.97605650-38fd-400b-add4-e68ab3df17cc Nov 06 18:37:03 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:03 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-432c7617-b487-4980-ada3-748c1c4c6a97 tempest-SnapshotMetadataTestJSON-57750533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.97605650-38fd-400b-add4-e68ab3df17cc" returned: 0 in 0.336s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:03 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-432c7617-b487-4980-ada3-748c1c4c6a97 tempest-SnapshotMetadataTestJSON-57750533 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.97605650-38fd-400b-add4-e68ab3df17cc is being set with open permissions: ugo+rw Nov 06 18:37:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-432c7617-b487-4980-ada3-748c1c4c6a97 tempest-SnapshotMetadataTestJSON-57750533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.97605650-38fd-400b-add4-e68ab3df17cc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:03 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.97605650-38fd-400b-add4-e68ab3df17cc Nov 06 18:37:03 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:04 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-432c7617-b487-4980-ada3-748c1c4c6a97 tempest-SnapshotMetadataTestJSON-57750533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.97605650-38fd-400b-add4-e68ab3df17cc" returned: 0 in 0.417s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-432c7617-b487-4980-ada3-748c1c4c6a97 tempest-SnapshotMetadataTestJSON-57750533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:04 devstack sudo[92541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.info Nov 06 18:37:04 devstack sudo[92541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:04 devstack sudo[92541]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-432c7617-b487-4980-ada3-748c1c4c6a97 tempest-SnapshotMetadataTestJSON-57750533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.info" returned: 0 in 0.373s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:04 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-432c7617-b487-4980-ada3-748c1c4c6a97 tempest-SnapshotMetadataTestJSON-57750533 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.info is being set with open permissions: ugo+rw Nov 06 18:37:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-432c7617-b487-4980-ada3-748c1c4c6a97 tempest-SnapshotMetadataTestJSON-57750533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:04 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.info Nov 06 18:37:04 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:05 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-432c7617-b487-4980-ada3-748c1c4c6a97 tempest-SnapshotMetadataTestJSON-57750533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.info" returned: 0 in 0.353s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-432c7617-b487-4980-ada3-748c1c4c6a97 tempest-SnapshotMetadataTestJSON-57750533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.680s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:37:05 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-432c7617-b487-4980-ada3-748c1c4c6a97 tempest-SnapshotMetadataTestJSON-57750533 None] Create snapshot completed successfully Nov 06 18:37:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] Acquiring lock "cinder-97605650-38fd-400b-add4-e68ab3df17cc-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:37:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] Lock "cinder-97605650-38fd-400b-add4-e68ab3df17cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:37:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] Acquiring lock "cinder-quobyte-6e4457f6-580f-44c6-bd60-ca69b9683bc1" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:37:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] Lock "cinder-quobyte-6e4457f6-580f-44c6-bd60-ca69b9683bc1" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:37:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] Acquiring lock "cinder-quobyte-97605650-38fd-400b-add4-e68ab3df17cc" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:37:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] Lock "cinder-quobyte-97605650-38fd-400b-add4-e68ab3df17cc" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:37:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] Deleting offline snapshot 97605650-38fd-400b-add4-e68ab3df17cc of volume 6e4457f6-580f-44c6-bd60-ca69b9683bc1 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:37:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] snapshot_file for this snap is: volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.97605650-38fd-400b-add4-e68ab3df17cc {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:37:07 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a90368-a7a5-4f1d-b3cd-a580e01bf481]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:37:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.97605650-38fd-400b-add4-e68ab3df17cc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:07 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.97605650-38fd-400b-add4-e68ab3df17cc Nov 06 18:37:07 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:07 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.97605650-38fd-400b-add4-e68ab3df17cc" returned: 0 in 0.592s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:37:07 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[96450d2b-9757-4d53-9503-207e4d68073f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:37:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:07 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-6700f8fc-f7fb-470b-8f73-ddf562ab5a48 tempest-ServerActionsTestOtherA-253261060 None] Terminate volume connection completed successfully. Nov 06 18:37:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-6700f8fc-f7fb-470b-8f73-ddf562ab5a48 tempest-ServerActionsTestOtherA-253261060 None] Deleting attachment 1a7c366d-8b8b-46fd-82ff-11e666695c83. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:37:07 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1 Nov 06 18:37:07 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-d0ba0528-5228-4cf3-ada1-5849110be4e9 tempest-ServerActionsTestOtherA-253261060 None] Acquiring lock "cinder-89caecd7-4fd9-4aab-8b30-64c79634d8c5-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:37:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-d0ba0528-5228-4cf3-ada1-5849110be4e9 tempest-ServerActionsTestOtherA-253261060 None] Lock "cinder-89caecd7-4fd9-4aab-8b30-64c79634d8c5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:37:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-d0ba0528-5228-4cf3-ada1-5849110be4e9 tempest-ServerActionsTestOtherA-253261060 None] Acquiring lock "cinder-quobyte-89caecd7-4fd9-4aab-8b30-64c79634d8c5" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:37:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-d0ba0528-5228-4cf3-ada1-5849110be4e9 tempest-ServerActionsTestOtherA-253261060 None] Lock "cinder-quobyte-89caecd7-4fd9-4aab-8b30-64c79634d8c5" acquired by "delete_volume" :: waited 0.023s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:37:08 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b938cf-252c-4143-802b-7cfcd40aedfd]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:37:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-d0ba0528-5228-4cf3-ada1-5849110be4e9 tempest-ServerActionsTestOtherA-253261060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:08 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1" returned: 0 in 0.684s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.97605650-38fd-400b-add4-e68ab3df17cc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:08 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.97605650-38fd-400b-add4-e68ab3df17cc Nov 06 18:37:08 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:08 devstack sudo[92585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5 Nov 06 18:37:08 devstack sudo[92585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:08 devstack sudo[92585]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-d0ba0528-5228-4cf3-ada1-5849110be4e9 tempest-ServerActionsTestOtherA-253261060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5" returned: 0 in 0.537s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-d0ba0528-5228-4cf3-ada1-5849110be4e9 tempest-ServerActionsTestOtherA-253261060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:08 devstack sudo[92593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5 Nov 06 18:37:08 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:09 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.97605650-38fd-400b-add4-e68ab3df17cc" returned: 0 in 0.811s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.97605650-38fd-400b-add4-e68ab3df17cc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:09 devstack sudo[92599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.97605650-38fd-400b-add4-e68ab3df17cc Nov 06 18:37:09 devstack sudo[92599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:09 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-d0ba0528-5228-4cf3-ada1-5849110be4e9 tempest-ServerActionsTestOtherA-253261060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89caecd7-4fd9-4aab-8b30-64c79634d8c5" returned: 0 in 0.478s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-d0ba0528-5228-4cf3-ada1-5849110be4e9 tempest-ServerActionsTestOtherA-253261060 None] Lock "cinder-quobyte-89caecd7-4fd9-4aab-8b30-64c79634d8c5" released by "delete_volume" :: held 1.107s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:37:09 devstack cinder-volume[86794]: DEBUG cinder.quota [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-d0ba0528-5228-4cf3-ada1-5849110be4e9 tempest-ServerActionsTestOtherA-253261060 None] Created reservations ['2bb8e6be-5c87-4656-a327-1b08d639b97a', '41cee982-7798-49f9-90d3-622c7e696a12', '3e242640-b88c-4c71-82e7-8ee52ade5fca', '63e19ef8-b4ed-45f3-b0dd-7b2dfea946cb'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:37:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-d0ba0528-5228-4cf3-ada1-5849110be4e9 tempest-ServerActionsTestOtherA-253261060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:37:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-d0ba0528-5228-4cf3-ada1-5849110be4e9 tempest-ServerActionsTestOtherA-253261060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:37:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-d0ba0528-5228-4cf3-ada1-5849110be4e9 tempest-ServerActionsTestOtherA-253261060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:37:09 devstack sudo[92599]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-d0ba0528-5228-4cf3-ada1-5849110be4e9 tempest-ServerActionsTestOtherA-253261060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:37:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-d0ba0528-5228-4cf3-ada1-5849110be4e9 tempest-ServerActionsTestOtherA-253261060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:37:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-d0ba0528-5228-4cf3-ada1-5849110be4e9 tempest-ServerActionsTestOtherA-253261060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1.97605650-38fd-400b-add4-e68ab3df17cc" returned: 0 in 0.338s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:09 devstack sudo[92602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:37:09 devstack sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] Lock "cinder-quobyte-97605650-38fd-400b-add4-e68ab3df17cc" released by "_delete_snapshot" :: held 2.607s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:37:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] Lock "cinder-quobyte-6e4457f6-580f-44c6-bd60-ca69b9683bc1" released by "delete_snapshot" :: held 2.661s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:37:09 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] Created reservations ['fab1de33-34ad-4e5a-961c-c07073c75ce4', '31aa2d8b-66ad-4f37-8efb-0ff045979768', '794d6915-150b-4411-af36-fa6377ce517d', '5b07870c-d800-405c-b7f1-1140c282615d'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:37:09 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] Delete snapshot completed successfully. Nov 06 18:37:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a1c94820-a25f-4a94-be18-0b1c6be4ecbf tempest-SnapshotMetadataTestJSON-57750533 None] Lock "cinder-97605650-38fd-400b-add4-e68ab3df17cc-delete_snapshot" released by "delete_snapshot" :: held 2.943s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:37:09 devstack sudo[92602]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-d0ba0528-5228-4cf3-ada1-5849110be4e9 tempest-ServerActionsTestOtherA-253261060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.389s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:09 devstack cinder-volume[86794]: DEBUG cinder.manager [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-d0ba0528-5228-4cf3-ada1-5849110be4e9 tempest-ServerActionsTestOtherA-253261060 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:37:09 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-d0ba0528-5228-4cf3-ada1-5849110be4e9 tempest-ServerActionsTestOtherA-253261060 None] Deleted volume successfully. Nov 06 18:37:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-872115e3-c515-494e-a2f3-dfd431d1d424 req-d0ba0528-5228-4cf3-ada1-5849110be4e9 tempest-ServerActionsTestOtherA-253261060 None] Lock "cinder-89caecd7-4fd9-4aab-8b30-64c79634d8c5-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:37:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c82ea462-e9ad-4ec0-b92c-597e3928fa22 tempest-ServerActionsTestOtherA-253261060 None] Acquiring lock "cinder-b54ddea4-20c3-41ed-9d8c-db970aa57fd4-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:37:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c82ea462-e9ad-4ec0-b92c-597e3928fa22 tempest-ServerActionsTestOtherA-253261060 None] Lock "cinder-b54ddea4-20c3-41ed-9d8c-db970aa57fd4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:37:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c82ea462-e9ad-4ec0-b92c-597e3928fa22 tempest-ServerActionsTestOtherA-253261060 None] Acquiring lock "cinder-quobyte-b54ddea4-20c3-41ed-9d8c-db970aa57fd4" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:37:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c82ea462-e9ad-4ec0-b92c-597e3928fa22 tempest-ServerActionsTestOtherA-253261060 None] Lock "cinder-quobyte-b54ddea4-20c3-41ed-9d8c-db970aa57fd4" acquired by "delete_volume" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:37:10 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[629b13fc-c794-4843-b4c9-2e320fe6027d]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:37:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c82ea462-e9ad-4ec0-b92c-597e3928fa22 tempest-ServerActionsTestOtherA-253261060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b54ddea4-20c3-41ed-9d8c-db970aa57fd4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-95eafd4e-2c9f-43cb-a84f-2fc40a7eda27 tempest-SnapshotMetadataTestJSON-57750533 None] Acquiring lock "cinder-6e4457f6-580f-44c6-bd60-ca69b9683bc1-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:37:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-95eafd4e-2c9f-43cb-a84f-2fc40a7eda27 tempest-SnapshotMetadataTestJSON-57750533 None] Lock "cinder-6e4457f6-580f-44c6-bd60-ca69b9683bc1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:37:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-95eafd4e-2c9f-43cb-a84f-2fc40a7eda27 tempest-SnapshotMetadataTestJSON-57750533 None] Acquiring lock "cinder-quobyte-6e4457f6-580f-44c6-bd60-ca69b9683bc1" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:37:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-95eafd4e-2c9f-43cb-a84f-2fc40a7eda27 tempest-SnapshotMetadataTestJSON-57750533 None] Lock "cinder-quobyte-6e4457f6-580f-44c6-bd60-ca69b9683bc1" acquired by "delete_volume" :: waited 0.035s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:37:10 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b06075-c7bc-4b69-a00d-b6b88bed03a8]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:37:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-95eafd4e-2c9f-43cb-a84f-2fc40a7eda27 tempest-SnapshotMetadataTestJSON-57750533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:10 devstack sudo[92605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b54ddea4-20c3-41ed-9d8c-db970aa57fd4 Nov 06 18:37:10 devstack sudo[92605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:10 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1 Nov 06 18:37:10 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:10 devstack sudo[92605]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c82ea462-e9ad-4ec0-b92c-597e3928fa22 tempest-ServerActionsTestOtherA-253261060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b54ddea4-20c3-41ed-9d8c-db970aa57fd4" returned: 0 in 0.561s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c82ea462-e9ad-4ec0-b92c-597e3928fa22 tempest-ServerActionsTestOtherA-253261060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b54ddea4-20c3-41ed-9d8c-db970aa57fd4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:10 devstack sudo[92612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b54ddea4-20c3-41ed-9d8c-db970aa57fd4 Nov 06 18:37:10 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:11 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-95eafd4e-2c9f-43cb-a84f-2fc40a7eda27 tempest-SnapshotMetadataTestJSON-57750533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1" returned: 0 in 0.545s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-95eafd4e-2c9f-43cb-a84f-2fc40a7eda27 tempest-SnapshotMetadataTestJSON-57750533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:11 devstack sudo[92617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1 Nov 06 18:37:11 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:11 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c82ea462-e9ad-4ec0-b92c-597e3928fa22 tempest-ServerActionsTestOtherA-253261060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b54ddea4-20c3-41ed-9d8c-db970aa57fd4" returned: 0 in 0.379s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:11 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c82ea462-e9ad-4ec0-b92c-597e3928fa22 tempest-ServerActionsTestOtherA-253261060 None] Lock "cinder-quobyte-b54ddea4-20c3-41ed-9d8c-db970aa57fd4" released by "delete_volume" :: held 1.011s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:37:11 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-c82ea462-e9ad-4ec0-b92c-597e3928fa22 tempest-ServerActionsTestOtherA-253261060 None] Created reservations ['60e2dfcc-d8d4-4cdc-994d-9f03dba499dd', 'b27294b0-c4fa-4818-97dc-0dca09083902', '1757bf23-6287-4a69-b963-79001f3ee17d', '86ff5c46-92b8-4523-936a-e7c5d0681ad7'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:37:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c82ea462-e9ad-4ec0-b92c-597e3928fa22 tempest-ServerActionsTestOtherA-253261060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:37:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c82ea462-e9ad-4ec0-b92c-597e3928fa22 tempest-ServerActionsTestOtherA-253261060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:37:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c82ea462-e9ad-4ec0-b92c-597e3928fa22 tempest-ServerActionsTestOtherA-253261060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:37:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c82ea462-e9ad-4ec0-b92c-597e3928fa22 tempest-ServerActionsTestOtherA-253261060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:37:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c82ea462-e9ad-4ec0-b92c-597e3928fa22 tempest-ServerActionsTestOtherA-253261060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:37:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c82ea462-e9ad-4ec0-b92c-597e3928fa22 tempest-ServerActionsTestOtherA-253261060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:11 devstack sudo[92621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:37:11 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:11 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-95eafd4e-2c9f-43cb-a84f-2fc40a7eda27 tempest-SnapshotMetadataTestJSON-57750533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6e4457f6-580f-44c6-bd60-ca69b9683bc1" returned: 0 in 0.566s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:11 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-95eafd4e-2c9f-43cb-a84f-2fc40a7eda27 tempest-SnapshotMetadataTestJSON-57750533 None] Lock "cinder-quobyte-6e4457f6-580f-44c6-bd60-ca69b9683bc1" released by "delete_volume" :: held 1.220s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:37:11 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-95eafd4e-2c9f-43cb-a84f-2fc40a7eda27 tempest-SnapshotMetadataTestJSON-57750533 None] Created reservations ['ca973d93-bccf-4e75-a2c5-ad5f5c3556b4', '063f6268-eb0c-4d2f-acbc-77e1c8d28bf3', 'c7c21a58-3cd1-4bdd-97e0-919876522c2d', 'a91691c2-1de3-43ab-98f3-0da0c6743104'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:37:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-95eafd4e-2c9f-43cb-a84f-2fc40a7eda27 tempest-SnapshotMetadataTestJSON-57750533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:37:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-95eafd4e-2c9f-43cb-a84f-2fc40a7eda27 tempest-SnapshotMetadataTestJSON-57750533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:37:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-95eafd4e-2c9f-43cb-a84f-2fc40a7eda27 tempest-SnapshotMetadataTestJSON-57750533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:37:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-95eafd4e-2c9f-43cb-a84f-2fc40a7eda27 tempest-SnapshotMetadataTestJSON-57750533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:37:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-95eafd4e-2c9f-43cb-a84f-2fc40a7eda27 tempest-SnapshotMetadataTestJSON-57750533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:37:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-95eafd4e-2c9f-43cb-a84f-2fc40a7eda27 tempest-SnapshotMetadataTestJSON-57750533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:11 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:37:11 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:12 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c82ea462-e9ad-4ec0-b92c-597e3928fa22 tempest-ServerActionsTestOtherA-253261060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.495s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:12 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-c82ea462-e9ad-4ec0-b92c-597e3928fa22 tempest-ServerActionsTestOtherA-253261060 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:37:12 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c82ea462-e9ad-4ec0-b92c-597e3928fa22 tempest-ServerActionsTestOtherA-253261060 None] Deleted volume successfully. Nov 06 18:37:12 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c82ea462-e9ad-4ec0-b92c-597e3928fa22 tempest-ServerActionsTestOtherA-253261060 None] Lock "cinder-b54ddea4-20c3-41ed-9d8c-db970aa57fd4-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:37:12 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-95eafd4e-2c9f-43cb-a84f-2fc40a7eda27 tempest-SnapshotMetadataTestJSON-57750533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.505s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:12 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-95eafd4e-2c9f-43cb-a84f-2fc40a7eda27 tempest-SnapshotMetadataTestJSON-57750533 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:37:12 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-95eafd4e-2c9f-43cb-a84f-2fc40a7eda27 tempest-SnapshotMetadataTestJSON-57750533 None] Deleted volume successfully. Nov 06 18:37:12 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-95eafd4e-2c9f-43cb-a84f-2fc40a7eda27 tempest-SnapshotMetadataTestJSON-57750533 None] Lock "cinder-6e4457f6-580f-44c6-bd60-ca69b9683bc1-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:37:18 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Flow 'volume_create_manager' (c15a757d-4551-4852-b51d-0a9adbdb75f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ad97a7-ab5b-46c3-93ac-fc4eab6ea44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ad97a7-ab5b-46c3-93ac-fc4eab6ea44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1530528590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d277c03-1d06-4848-a503-eaec22d53ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a99ee7b314bb4c6582a5e6d86f24fb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:37:19Z,use_quota=True,user_id='4a540f9e397e497582b7905f362aafca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb19a107-f95c-4cb3-adc5-cf1f7b632f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb19a107-f95c-4cb3-adc5-cf1f7b632f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918a9c1e-8b9e-43e3-a90f-2f0f89b99cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918a9c1e-8b9e-43e3-a90f-2f0f89b99cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d277c03-1d06-4848-a503-eaec22d53ebc', 'volume_name': 'volume-3d277c03-1d06-4848-a503-eaec22d53ebc', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83f1fa3-ee4b-4f3e-9f48-f41ba0b4fdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83f1fa3-ee4b-4f3e-9f48-f41ba0b4fdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d68f28-0ada-4144-817d-eff5635ee7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:19 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Volume 3d277c03-1d06-4848-a503-eaec22d53ebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d277c03-1d06-4848-a503-eaec22d53ebc', 'volume_size': 1} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1530528590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d277c03-1d06-4848-a503-eaec22d53ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a99ee7b314bb4c6582a5e6d86f24fb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:37:19Z,use_quota=True,user_id='4a540f9e397e497582b7905f362aafca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Creating volume 3d277c03-1d06-4848-a503-eaec22d53ebc {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:37:19 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d277c03-1d06-4848-a503-eaec22d53ebc 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:19 devstack sudo[92694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d277c03-1d06-4848-a503-eaec22d53ebc 1073741824 Nov 06 18:37:19 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:19 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d277c03-1d06-4848-a503-eaec22d53ebc 1073741824" returned: 0 in 0.581s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d277c03-1d06-4848-a503-eaec22d53ebc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:19 devstack sudo[92715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d277c03-1d06-4848-a503-eaec22d53ebc Nov 06 18:37:19 devstack sudo[92715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:20 devstack sudo[92715]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d277c03-1d06-4848-a503-eaec22d53ebc" returned: 0 in 0.491s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:37:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:37:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d68f28-0ada-4144-817d-eff5635ee7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d277c03-1d06-4848-a503-eaec22d53ebc', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3900656b-bad0-465b-b48c-f9c6c380fe9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:20 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Volume volume-3d277c03-1d06-4848-a503-eaec22d53ebc (3d277c03-1d06-4848-a503-eaec22d53ebc): created successfully Nov 06 18:37:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3900656b-bad0-465b-b48c-f9c6c380fe9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Flow 'volume_create_manager' (c15a757d-4551-4852-b51d-0a9adbdb75f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:37:20 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-f456b765-9ffc-4f6b-9c19-27f96d2185a0 tempest-VolumesMetadataTest-19149975 None] Created volume successfully. Nov 06 18:37:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e8d346d6-8654-4131-a63e-748f5a733c09 tempest-VolumesMetadataTest-19149975 None] Acquiring lock "cinder-3d277c03-1d06-4848-a503-eaec22d53ebc-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:37:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e8d346d6-8654-4131-a63e-748f5a733c09 tempest-VolumesMetadataTest-19149975 None] Lock "cinder-3d277c03-1d06-4848-a503-eaec22d53ebc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:37:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e8d346d6-8654-4131-a63e-748f5a733c09 tempest-VolumesMetadataTest-19149975 None] Acquiring lock "cinder-quobyte-3d277c03-1d06-4848-a503-eaec22d53ebc" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:37:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e8d346d6-8654-4131-a63e-748f5a733c09 tempest-VolumesMetadataTest-19149975 None] Lock "cinder-quobyte-3d277c03-1d06-4848-a503-eaec22d53ebc" acquired by "delete_volume" :: waited 0.031s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:37:22 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b90fa1-6ebc-4c2f-831c-e1b04beda39b]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:37:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e8d346d6-8654-4131-a63e-748f5a733c09 tempest-VolumesMetadataTest-19149975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d277c03-1d06-4848-a503-eaec22d53ebc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:22 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d277c03-1d06-4848-a503-eaec22d53ebc Nov 06 18:37:22 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:22 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e8d346d6-8654-4131-a63e-748f5a733c09 tempest-VolumesMetadataTest-19149975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d277c03-1d06-4848-a503-eaec22d53ebc" returned: 0 in 0.457s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e8d346d6-8654-4131-a63e-748f5a733c09 tempest-VolumesMetadataTest-19149975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d277c03-1d06-4848-a503-eaec22d53ebc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:22 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d277c03-1d06-4848-a503-eaec22d53ebc Nov 06 18:37:22 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:22 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e8d346d6-8654-4131-a63e-748f5a733c09 tempest-VolumesMetadataTest-19149975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d277c03-1d06-4848-a503-eaec22d53ebc" returned: 0 in 0.395s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e8d346d6-8654-4131-a63e-748f5a733c09 tempest-VolumesMetadataTest-19149975 None] Lock "cinder-quobyte-3d277c03-1d06-4848-a503-eaec22d53ebc" released by "delete_volume" :: held 1.046s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:37:23 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-e8d346d6-8654-4131-a63e-748f5a733c09 tempest-VolumesMetadataTest-19149975 None] Created reservations ['2957e883-c6d2-467a-b356-3d95690cf72b', 'e380f020-34d0-42b3-ad4d-b8b534824bec', '0ead8072-66f7-4b05-aa22-7273f392fb4a', '156c4744-ecc1-4396-93aa-a4a34ed972c0'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:37:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e8d346d6-8654-4131-a63e-748f5a733c09 tempest-VolumesMetadataTest-19149975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:37:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e8d346d6-8654-4131-a63e-748f5a733c09 tempest-VolumesMetadataTest-19149975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:37:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e8d346d6-8654-4131-a63e-748f5a733c09 tempest-VolumesMetadataTest-19149975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:37:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e8d346d6-8654-4131-a63e-748f5a733c09 tempest-VolumesMetadataTest-19149975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:37:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e8d346d6-8654-4131-a63e-748f5a733c09 tempest-VolumesMetadataTest-19149975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:37:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e8d346d6-8654-4131-a63e-748f5a733c09 tempest-VolumesMetadataTest-19149975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:23 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:37:23 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:24 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e8d346d6-8654-4131-a63e-748f5a733c09 tempest-VolumesMetadataTest-19149975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.679s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:24 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-e8d346d6-8654-4131-a63e-748f5a733c09 tempest-VolumesMetadataTest-19149975 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:37:24 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-e8d346d6-8654-4131-a63e-748f5a733c09 tempest-VolumesMetadataTest-19149975 None] Deleted volume successfully. Nov 06 18:37:24 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e8d346d6-8654-4131-a63e-748f5a733c09 tempest-VolumesMetadataTest-19149975 None] Lock "cinder-3d277c03-1d06-4848-a503-eaec22d53ebc-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:37:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:37:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:37:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:37:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:37:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:37:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:37:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:29 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:37:29 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.901s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:30 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:37:30 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:30 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:37:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 29 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:37:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:37:33 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=37,cinder:UPDATE=44,cinder:DELETE=3,cinder:INSERT=14 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:37:34 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:UPDATE=46,cinder:SELECT=31,cinder:INSERT=9,cinder:DELETE=4 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:37:35 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-31647d38-33c4-4abe-a285-6f13d2b068c3 tempest-AttachVolumeShelveTestJSON-1400662468 None] Acquiring lock "cinder-68d53999-5d9d-4f4b-a467-991fe225d77c-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:37:35 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-31647d38-33c4-4abe-a285-6f13d2b068c3 tempest-AttachVolumeShelveTestJSON-1400662468 None] Lock "cinder-68d53999-5d9d-4f4b-a467-991fe225d77c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:37:35 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-31647d38-33c4-4abe-a285-6f13d2b068c3 tempest-AttachVolumeShelveTestJSON-1400662468 None] Acquiring lock "cinder-quobyte-68d53999-5d9d-4f4b-a467-991fe225d77c" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:37:35 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-31647d38-33c4-4abe-a285-6f13d2b068c3 tempest-AttachVolumeShelveTestJSON-1400662468 None] Lock "cinder-quobyte-68d53999-5d9d-4f4b-a467-991fe225d77c" acquired by "delete_volume" :: waited 0.043s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:37:35 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9cf846-b64d-4210-acfa-6c741df51c9e]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:37:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-31647d38-33c4-4abe-a285-6f13d2b068c3 tempest-AttachVolumeShelveTestJSON-1400662468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-68d53999-5d9d-4f4b-a467-991fe225d77c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:35 devstack sudo[92915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-68d53999-5d9d-4f4b-a467-991fe225d77c Nov 06 18:37:35 devstack sudo[92915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:36 devstack sudo[92915]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-31647d38-33c4-4abe-a285-6f13d2b068c3 tempest-AttachVolumeShelveTestJSON-1400662468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-68d53999-5d9d-4f4b-a467-991fe225d77c" returned: 0 in 0.973s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-31647d38-33c4-4abe-a285-6f13d2b068c3 tempest-AttachVolumeShelveTestJSON-1400662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-68d53999-5d9d-4f4b-a467-991fe225d77c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:36 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-68d53999-5d9d-4f4b-a467-991fe225d77c Nov 06 18:37:36 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:37 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-31647d38-33c4-4abe-a285-6f13d2b068c3 tempest-AttachVolumeShelveTestJSON-1400662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-68d53999-5d9d-4f4b-a467-991fe225d77c" returned: 0 in 0.581s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-31647d38-33c4-4abe-a285-6f13d2b068c3 tempest-AttachVolumeShelveTestJSON-1400662468 None] Lock "cinder-quobyte-68d53999-5d9d-4f4b-a467-991fe225d77c" released by "delete_volume" :: held 1.666s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:37:37 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-31647d38-33c4-4abe-a285-6f13d2b068c3 tempest-AttachVolumeShelveTestJSON-1400662468 None] Created reservations ['f822b68e-7ac8-4423-a90d-bc1fb70bd182', 'c4818d52-647e-4ba1-8944-ca23b526e672', '35bd1c53-9441-4136-8593-e4786f451cce', '3d5bed31-ddc1-4985-8456-7827e42891ab'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:37:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-31647d38-33c4-4abe-a285-6f13d2b068c3 tempest-AttachVolumeShelveTestJSON-1400662468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:37:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-31647d38-33c4-4abe-a285-6f13d2b068c3 tempest-AttachVolumeShelveTestJSON-1400662468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:37:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-31647d38-33c4-4abe-a285-6f13d2b068c3 tempest-AttachVolumeShelveTestJSON-1400662468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:37:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-31647d38-33c4-4abe-a285-6f13d2b068c3 tempest-AttachVolumeShelveTestJSON-1400662468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:37:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-31647d38-33c4-4abe-a285-6f13d2b068c3 tempest-AttachVolumeShelveTestJSON-1400662468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:37:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-31647d38-33c4-4abe-a285-6f13d2b068c3 tempest-AttachVolumeShelveTestJSON-1400662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:37 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:37:37 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:38 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-31647d38-33c4-4abe-a285-6f13d2b068c3 tempest-AttachVolumeShelveTestJSON-1400662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 1.078s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:38 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-31647d38-33c4-4abe-a285-6f13d2b068c3 tempest-AttachVolumeShelveTestJSON-1400662468 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:37:38 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-31647d38-33c4-4abe-a285-6f13d2b068c3 tempest-AttachVolumeShelveTestJSON-1400662468 None] Deleted volume successfully. Nov 06 18:37:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-31647d38-33c4-4abe-a285-6f13d2b068c3 tempest-AttachVolumeShelveTestJSON-1400662468 None] Lock "cinder-68d53999-5d9d-4f4b-a467-991fe225d77c-delete_volume" released by "delete_volume" :: held 3.252s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Flow 'volume_create_manager' (2303d3e3-826e-4de0-84e9-7c7a97b2950c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720bcef2-86ac-4b26-a8a2-5e9eb19364e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720bcef2-86ac-4b26-a8a2-5e9eb19364e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1629990071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c041bc8-95d5-4a88-8235-71d4df821363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84effdfb43d44a2c99d5e1243b602daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:37:39Z,use_quota=True,user_id='5b920904a12048119e05e49e507b6051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db08d78-fa5c-43d1-b123-a41322ea8384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db08d78-fa5c-43d1-b123-a41322ea8384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6868fb44-0554-4275-8775-903cb68a7f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6868fb44-0554-4275-8775-903cb68a7f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c041bc8-95d5-4a88-8235-71d4df821363', 'volume_name': 'volume-0c041bc8-95d5-4a88-8235-71d4df821363', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3797c069-b8e2-4263-83d0-e06218bae826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3797c069-b8e2-4263-83d0-e06218bae826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69709aee-c2bb-488e-afb4-7527621fccb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:39 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Volume 0c041bc8-95d5-4a88-8235-71d4df821363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c041bc8-95d5-4a88-8235-71d4df821363', 'volume_size': 1} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1629990071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c041bc8-95d5-4a88-8235-71d4df821363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84effdfb43d44a2c99d5e1243b602daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:37:39Z,use_quota=True,user_id='5b920904a12048119e05e49e507b6051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Creating volume 0c041bc8-95d5-4a88-8235-71d4df821363 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:37:39 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:37:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0c041bc8-95d5-4a88-8235-71d4df821363 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:39 devstack sudo[93001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0c041bc8-95d5-4a88-8235-71d4df821363 1073741824 Nov 06 18:37:39 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Flow 'volume_create_manager' (705656a5-a31a-4b71-9d33-4d8e8587e09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607b5809-350e-4e1b-9783-a697ea4ffa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607b5809-350e-4e1b-9783-a697ea4ffa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1575053776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9111b63b-a53d-40bb-9e82-933ab53fee18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ed211e0e1d14a00bb6f6252674e9532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:37:40Z,use_quota=True,user_id='84b7dcdc0d834cdcbad78f6dad4d0443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7252941c-fdb1-48aa-8ecc-7147cf98a0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7252941c-fdb1-48aa-8ecc-7147cf98a0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8896b870-12b1-4b1d-ac70-c9a509bb7e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8896b870-12b1-4b1d-ac70-c9a509bb7e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9111b63b-a53d-40bb-9e82-933ab53fee18', 'volume_name': 'volume-9111b63b-a53d-40bb-9e82-933ab53fee18', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c32f3b-b32a-49a3-bdb3-c6c7a7c051c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c32f3b-b32a-49a3-bdb3-c6c7a7c051c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f492ea0f-cf3b-491d-8526-75b5cb44236a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:40 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Volume 9111b63b-a53d-40bb-9e82-933ab53fee18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9111b63b-a53d-40bb-9e82-933ab53fee18', 'volume_size': 1} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:37:40 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0c041bc8-95d5-4a88-8235-71d4df821363 1073741824" returned: 0 in 0.897s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0c041bc8-95d5-4a88-8235-71d4df821363 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:40 devstack sudo[93007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0c041bc8-95d5-4a88-8235-71d4df821363 Nov 06 18:37:40 devstack sudo[93007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:40 devstack sudo[93007]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0c041bc8-95d5-4a88-8235-71d4df821363" returned: 0 in 0.413s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.807s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1575053776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9111b63b-a53d-40bb-9e82-933ab53fee18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ed211e0e1d14a00bb6f6252674e9532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:37:40Z,use_quota=True,user_id='84b7dcdc0d834cdcbad78f6dad4d0443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Creating volume 9111b63b-a53d-40bb-9e82-933ab53fee18 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:37:40 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9111b63b-a53d-40bb-9e82-933ab53fee18 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69709aee-c2bb-488e-afb4-7527621fccb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c041bc8-95d5-4a88-8235-71d4df821363', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:40 devstack sudo[93010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9111b63b-a53d-40bb-9e82-933ab53fee18 1073741824 Nov 06 18:37:40 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7110b3d1-ec5e-4ebf-8954-07b73c216dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:41 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Volume volume-0c041bc8-95d5-4a88-8235-71d4df821363 (0c041bc8-95d5-4a88-8235-71d4df821363): created successfully Nov 06 18:37:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7110b3d1-ec5e-4ebf-8954-07b73c216dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Flow 'volume_create_manager' (2303d3e3-826e-4de0-84e9-7c7a97b2950c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:37:41 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-e171d914-966c-40e5-a89f-792059f08125 tempest-ServerRescueNegativeTestJSON-611127582 None] Created volume successfully. Nov 06 18:37:41 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9111b63b-a53d-40bb-9e82-933ab53fee18 1073741824" returned: 0 in 0.678s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9111b63b-a53d-40bb-9e82-933ab53fee18 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:41 devstack sudo[93018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9111b63b-a53d-40bb-9e82-933ab53fee18 Nov 06 18:37:41 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:42 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9111b63b-a53d-40bb-9e82-933ab53fee18" returned: 0 in 0.517s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:37:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:37:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f492ea0f-cf3b-491d-8526-75b5cb44236a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9111b63b-a53d-40bb-9e82-933ab53fee18', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca4dd90-ee84-4b3c-af2c-cc244b3ceebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:42 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Volume volume-9111b63b-a53d-40bb-9e82-933ab53fee18 (9111b63b-a53d-40bb-9e82-933ab53fee18): created successfully Nov 06 18:37:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca4dd90-ee84-4b3c-af2c-cc244b3ceebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Flow 'volume_create_manager' (705656a5-a31a-4b71-9d33-4d8e8587e09d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:37:42 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-96369162-27b8-49ea-be2f-e77f5ba278dc tempest-VolumesTransfersV355Test-966894976 None] Created volume successfully. Nov 06 18:37:44 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-feebe644-0fe6-414f-b992-5f5837903ccd tempest-VolumesTransfersV355Test-2100037552 None] Transfer volume completed successfully. Nov 06 18:37:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fddb6740-f2f1-4e9d-913d-2fe05ee5ef75 tempest-VolumesTransfersV355Test-232087469 None] Acquiring lock "cinder-9111b63b-a53d-40bb-9e82-933ab53fee18-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:37:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fddb6740-f2f1-4e9d-913d-2fe05ee5ef75 tempest-VolumesTransfersV355Test-232087469 None] Lock "cinder-9111b63b-a53d-40bb-9e82-933ab53fee18-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:37:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fddb6740-f2f1-4e9d-913d-2fe05ee5ef75 tempest-VolumesTransfersV355Test-232087469 None] Acquiring lock "cinder-quobyte-9111b63b-a53d-40bb-9e82-933ab53fee18" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:37:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fddb6740-f2f1-4e9d-913d-2fe05ee5ef75 tempest-VolumesTransfersV355Test-232087469 None] Lock "cinder-quobyte-9111b63b-a53d-40bb-9e82-933ab53fee18" acquired by "delete_volume" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:37:45 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fae383a-a449-47f1-b9ed-17fc3ad84e27]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:37:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fddb6740-f2f1-4e9d-913d-2fe05ee5ef75 tempest-VolumesTransfersV355Test-232087469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9111b63b-a53d-40bb-9e82-933ab53fee18 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:45 devstack sudo[93023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9111b63b-a53d-40bb-9e82-933ab53fee18 Nov 06 18:37:45 devstack sudo[93023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:45 devstack sudo[93023]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fddb6740-f2f1-4e9d-913d-2fe05ee5ef75 tempest-VolumesTransfersV355Test-232087469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9111b63b-a53d-40bb-9e82-933ab53fee18" returned: 0 in 0.670s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fddb6740-f2f1-4e9d-913d-2fe05ee5ef75 tempest-VolumesTransfersV355Test-232087469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9111b63b-a53d-40bb-9e82-933ab53fee18 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:45 devstack sudo[93028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9111b63b-a53d-40bb-9e82-933ab53fee18 Nov 06 18:37:45 devstack sudo[93028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:46 devstack sudo[93028]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fddb6740-f2f1-4e9d-913d-2fe05ee5ef75 tempest-VolumesTransfersV355Test-232087469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9111b63b-a53d-40bb-9e82-933ab53fee18" returned: 0 in 0.454s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:46 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fddb6740-f2f1-4e9d-913d-2fe05ee5ef75 tempest-VolumesTransfersV355Test-232087469 None] Lock "cinder-quobyte-9111b63b-a53d-40bb-9e82-933ab53fee18" released by "delete_volume" :: held 1.189s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:37:46 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-fddb6740-f2f1-4e9d-913d-2fe05ee5ef75 tempest-VolumesTransfersV355Test-232087469 None] Created reservations ['051b9785-e050-4840-847a-0a508bb7f019', 'cefc2d66-0025-45a5-8a9c-eb60732b4f83', '4f6ebac9-67b4-4681-8199-ccd3b29e0108', '7422418c-38d7-47e7-b91d-fdfbb26ac580'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:37:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fddb6740-f2f1-4e9d-913d-2fe05ee5ef75 tempest-VolumesTransfersV355Test-232087469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:37:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fddb6740-f2f1-4e9d-913d-2fe05ee5ef75 tempest-VolumesTransfersV355Test-232087469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:37:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fddb6740-f2f1-4e9d-913d-2fe05ee5ef75 tempest-VolumesTransfersV355Test-232087469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:37:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fddb6740-f2f1-4e9d-913d-2fe05ee5ef75 tempest-VolumesTransfersV355Test-232087469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:37:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fddb6740-f2f1-4e9d-913d-2fe05ee5ef75 tempest-VolumesTransfersV355Test-232087469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:37:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fddb6740-f2f1-4e9d-913d-2fe05ee5ef75 tempest-VolumesTransfersV355Test-232087469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:46 devstack sudo[93031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:37:46 devstack sudo[93031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:47 devstack sudo[93031]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fddb6740-f2f1-4e9d-913d-2fe05ee5ef75 tempest-VolumesTransfersV355Test-232087469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.526s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:47 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-fddb6740-f2f1-4e9d-913d-2fe05ee5ef75 tempest-VolumesTransfersV355Test-232087469 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:37:47 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-fddb6740-f2f1-4e9d-913d-2fe05ee5ef75 tempest-VolumesTransfersV355Test-232087469 None] Deleted volume successfully. Nov 06 18:37:47 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fddb6740-f2f1-4e9d-913d-2fe05ee5ef75 tempest-VolumesTransfersV355Test-232087469 None] Lock "cinder-9111b63b-a53d-40bb-9e82-933ab53fee18-delete_volume" released by "delete_volume" :: held 2.075s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Flow 'volume_create_manager' (95071f5d-8cb1-4376-a575-3e5d394de97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa99126f-620f-483f-8e03-60f0d3ea0b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa99126f-620f-483f-8e03-60f0d3ea0b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1973472665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de79d6d0-48a8-4298-ac39-a1c45caab11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ed211e0e1d14a00bb6f6252674e9532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:37:49Z,use_quota=True,user_id='84b7dcdc0d834cdcbad78f6dad4d0443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a6d53a7-36a2-4eb7-9d75-13dd042fc6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a6d53a7-36a2-4eb7-9d75-13dd042fc6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec7f066-445b-4f2d-919e-56957fdee5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec7f066-445b-4f2d-919e-56957fdee5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de79d6d0-48a8-4298-ac39-a1c45caab11a', 'volume_name': 'volume-de79d6d0-48a8-4298-ac39-a1c45caab11a', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7048b4a-70be-4340-91dd-938af4a7d9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7048b4a-70be-4340-91dd-938af4a7d9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857ea8b8-bcd4-4d81-9127-d615d05c0faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:48 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Volume de79d6d0-48a8-4298-ac39-a1c45caab11a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de79d6d0-48a8-4298-ac39-a1c45caab11a', 'volume_size': 1} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1973472665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de79d6d0-48a8-4298-ac39-a1c45caab11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ed211e0e1d14a00bb6f6252674e9532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:37:49Z,use_quota=True,user_id='84b7dcdc0d834cdcbad78f6dad4d0443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Creating volume de79d6d0-48a8-4298-ac39-a1c45caab11a {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:37:48 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:37:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de79d6d0-48a8-4298-ac39-a1c45caab11a 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:48 devstack sudo[93040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de79d6d0-48a8-4298-ac39-a1c45caab11a 1073741824 Nov 06 18:37:48 devstack sudo[93040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:50 devstack sudo[93040]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de79d6d0-48a8-4298-ac39-a1c45caab11a 1073741824" returned: 0 in 1.247s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de79d6d0-48a8-4298-ac39-a1c45caab11a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:50 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de79d6d0-48a8-4298-ac39-a1c45caab11a Nov 06 18:37:50 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:50 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de79d6d0-48a8-4298-ac39-a1c45caab11a" returned: 0 in 0.511s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:50 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:37:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:37:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857ea8b8-bcd4-4d81-9127-d615d05c0faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de79d6d0-48a8-4298-ac39-a1c45caab11a', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e12b732-8264-4ff1-8be7-3477d900d64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:37:50 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Volume volume-de79d6d0-48a8-4298-ac39-a1c45caab11a (de79d6d0-48a8-4298-ac39-a1c45caab11a): created successfully Nov 06 18:37:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e12b732-8264-4ff1-8be7-3477d900d64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:37:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Flow 'volume_create_manager' (95071f5d-8cb1-4376-a575-3e5d394de97e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:37:50 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-db29e62a-656d-404f-ab50-34eb1d930921 tempest-VolumesTransfersV355Test-966894976 None] Created volume successfully. Nov 06 18:37:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a314bf6e-e967-47b3-a77e-b690cdd3f15e tempest-VolumesTransfersV355Test-232087469 None] Acquiring lock "cinder-de79d6d0-48a8-4298-ac39-a1c45caab11a-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:37:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a314bf6e-e967-47b3-a77e-b690cdd3f15e tempest-VolumesTransfersV355Test-232087469 None] Lock "cinder-de79d6d0-48a8-4298-ac39-a1c45caab11a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:37:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a314bf6e-e967-47b3-a77e-b690cdd3f15e tempest-VolumesTransfersV355Test-232087469 None] Acquiring lock "cinder-quobyte-de79d6d0-48a8-4298-ac39-a1c45caab11a" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:37:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a314bf6e-e967-47b3-a77e-b690cdd3f15e tempest-VolumesTransfersV355Test-232087469 None] Lock "cinder-quobyte-de79d6d0-48a8-4298-ac39-a1c45caab11a" acquired by "delete_volume" :: waited 0.030s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:37:52 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[41289d63-515c-4d0e-8686-3534468056c3]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:37:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a314bf6e-e967-47b3-a77e-b690cdd3f15e tempest-VolumesTransfersV355Test-232087469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de79d6d0-48a8-4298-ac39-a1c45caab11a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:52 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de79d6d0-48a8-4298-ac39-a1c45caab11a Nov 06 18:37:52 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:53 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a314bf6e-e967-47b3-a77e-b690cdd3f15e tempest-VolumesTransfersV355Test-232087469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de79d6d0-48a8-4298-ac39-a1c45caab11a" returned: 0 in 0.654s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a314bf6e-e967-47b3-a77e-b690cdd3f15e tempest-VolumesTransfersV355Test-232087469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de79d6d0-48a8-4298-ac39-a1c45caab11a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:53 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de79d6d0-48a8-4298-ac39-a1c45caab11a Nov 06 18:37:53 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:53 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a314bf6e-e967-47b3-a77e-b690cdd3f15e tempest-VolumesTransfersV355Test-232087469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de79d6d0-48a8-4298-ac39-a1c45caab11a" returned: 0 in 0.352s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:53 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a314bf6e-e967-47b3-a77e-b690cdd3f15e tempest-VolumesTransfersV355Test-232087469 None] Lock "cinder-quobyte-de79d6d0-48a8-4298-ac39-a1c45caab11a" released by "delete_volume" :: held 1.097s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:37:53 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-a314bf6e-e967-47b3-a77e-b690cdd3f15e tempest-VolumesTransfersV355Test-232087469 None] Created reservations ['c5061533-3f8f-4e11-89fa-3f374265976d', '93c7337d-787e-462e-a365-d1f957e51b32', 'e5b56ff4-a012-4999-ac21-f7575762b073', 'ae0e94b5-ca22-49a5-a726-3787b51e8314'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:37:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a314bf6e-e967-47b3-a77e-b690cdd3f15e tempest-VolumesTransfersV355Test-232087469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:37:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a314bf6e-e967-47b3-a77e-b690cdd3f15e tempest-VolumesTransfersV355Test-232087469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:37:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a314bf6e-e967-47b3-a77e-b690cdd3f15e tempest-VolumesTransfersV355Test-232087469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:37:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a314bf6e-e967-47b3-a77e-b690cdd3f15e tempest-VolumesTransfersV355Test-232087469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:37:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a314bf6e-e967-47b3-a77e-b690cdd3f15e tempest-VolumesTransfersV355Test-232087469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:37:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a314bf6e-e967-47b3-a77e-b690cdd3f15e tempest-VolumesTransfersV355Test-232087469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:37:53 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:37:53 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:37:54 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Nov 06 18:37:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a314bf6e-e967-47b3-a77e-b690cdd3f15e tempest-VolumesTransfersV355Test-232087469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.340s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:37:54 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-a314bf6e-e967-47b3-a77e-b690cdd3f15e tempest-VolumesTransfersV355Test-232087469 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:37:54 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a314bf6e-e967-47b3-a77e-b690cdd3f15e tempest-VolumesTransfersV355Test-232087469 None] Deleted volume successfully. Nov 06 18:37:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a314bf6e-e967-47b3-a77e-b690cdd3f15e tempest-VolumesTransfersV355Test-232087469 None] Lock "cinder-de79d6d0-48a8-4298-ac39-a1c45caab11a-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:38:02 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-38316754-58c8-48a7-85c9-04f5acd6c8ea tempest-ServerRescueNegativeTestJSON-611127582 None] Acquiring lock "cinder-0c041bc8-95d5-4a88-8235-71d4df821363-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:38:02 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-38316754-58c8-48a7-85c9-04f5acd6c8ea tempest-ServerRescueNegativeTestJSON-611127582 None] Lock "cinder-0c041bc8-95d5-4a88-8235-71d4df821363-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:38:02 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-38316754-58c8-48a7-85c9-04f5acd6c8ea tempest-ServerRescueNegativeTestJSON-611127582 None] Acquiring lock "cinder-quobyte-0c041bc8-95d5-4a88-8235-71d4df821363" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:38:02 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-38316754-58c8-48a7-85c9-04f5acd6c8ea tempest-ServerRescueNegativeTestJSON-611127582 None] Lock "cinder-quobyte-0c041bc8-95d5-4a88-8235-71d4df821363" acquired by "delete_volume" :: waited 0.024s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:38:02 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d74864f-5c62-4317-a10d-88021490b93b]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:38:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-38316754-58c8-48a7-85c9-04f5acd6c8ea tempest-ServerRescueNegativeTestJSON-611127582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0c041bc8-95d5-4a88-8235-71d4df821363 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:38:03 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0c041bc8-95d5-4a88-8235-71d4df821363 Nov 06 18:38:03 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:38:03 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Nov 06 18:38:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-38316754-58c8-48a7-85c9-04f5acd6c8ea tempest-ServerRescueNegativeTestJSON-611127582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0c041bc8-95d5-4a88-8235-71d4df821363" returned: 0 in 0.650s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:38:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-38316754-58c8-48a7-85c9-04f5acd6c8ea tempest-ServerRescueNegativeTestJSON-611127582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0c041bc8-95d5-4a88-8235-71d4df821363 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:38:03 devstack sudo[93175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0c041bc8-95d5-4a88-8235-71d4df821363 Nov 06 18:38:03 devstack sudo[93175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:38:03 devstack sudo[93175]: pam_unix(sudo:session): session closed for user root Nov 06 18:38:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-38316754-58c8-48a7-85c9-04f5acd6c8ea tempest-ServerRescueNegativeTestJSON-611127582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0c041bc8-95d5-4a88-8235-71d4df821363" returned: 0 in 0.364s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:38:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-38316754-58c8-48a7-85c9-04f5acd6c8ea tempest-ServerRescueNegativeTestJSON-611127582 None] Lock "cinder-quobyte-0c041bc8-95d5-4a88-8235-71d4df821363" released by "delete_volume" :: held 1.115s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:38:04 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-38316754-58c8-48a7-85c9-04f5acd6c8ea tempest-ServerRescueNegativeTestJSON-611127582 None] Created reservations ['5e21a8f3-c033-4f35-b015-64747a0ce838', '9f38f76a-fba0-4d93-8866-dd474d6063ca', '486ad12c-b542-431d-8897-eb74667b59be', '2bb21068-137c-4cbd-be82-aa78cda5718b'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:38:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-38316754-58c8-48a7-85c9-04f5acd6c8ea tempest-ServerRescueNegativeTestJSON-611127582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:38:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-38316754-58c8-48a7-85c9-04f5acd6c8ea tempest-ServerRescueNegativeTestJSON-611127582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:38:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-38316754-58c8-48a7-85c9-04f5acd6c8ea tempest-ServerRescueNegativeTestJSON-611127582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:38:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-38316754-58c8-48a7-85c9-04f5acd6c8ea tempest-ServerRescueNegativeTestJSON-611127582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:38:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-38316754-58c8-48a7-85c9-04f5acd6c8ea tempest-ServerRescueNegativeTestJSON-611127582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:38:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-38316754-58c8-48a7-85c9-04f5acd6c8ea tempest-ServerRescueNegativeTestJSON-611127582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:38:04 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:38:04 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:38:04 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Nov 06 18:38:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-38316754-58c8-48a7-85c9-04f5acd6c8ea tempest-ServerRescueNegativeTestJSON-611127582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.403s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:38:04 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-38316754-58c8-48a7-85c9-04f5acd6c8ea tempest-ServerRescueNegativeTestJSON-611127582 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:38:04 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-38316754-58c8-48a7-85c9-04f5acd6c8ea tempest-ServerRescueNegativeTestJSON-611127582 None] Deleted volume successfully. Nov 06 18:38:04 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-38316754-58c8-48a7-85c9-04f5acd6c8ea tempest-ServerRescueNegativeTestJSON-611127582 None] Lock "cinder-0c041bc8-95d5-4a88-8235-71d4df821363-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=28,cinder:INSERT=9,cinder:UPDATE=40,cinder:DELETE=3 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Flow 'volume_create_manager' (37dd95bd-2153-4c69-b656-f07556f929bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71520ec-60bf-4918-8c79-368891a9126a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71520ec-60bf-4918-8c79-368891a9126a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1089505468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d958ebee-5e7e-4e74-a811-3738b17fc346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02df6ce066a469684e9342918d900ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:38:14Z,use_quota=True,user_id='13dbb1f75f234a1dae57ff4334ba7f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d58f82-8e81-47f8-8e15-708c7cf555bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d58f82-8e81-47f8-8e15-708c7cf555bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e01b16ba-edc2-4255-8be1-40c459f2f555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e01b16ba-edc2-4255-8be1-40c459f2f555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd958ebee-5e7e-4e74-a811-3738b17fc346', 'volume_name': 'volume-d958ebee-5e7e-4e74-a811-3738b17fc346', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6efc86-ee26-4a9c-ab2a-f8c62faeec59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6efc86-ee26-4a9c-ab2a-f8c62faeec59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6cc249-bf4c-4b9d-8dd9-72a5f73a064d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:14 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Volume d958ebee-5e7e-4e74-a811-3738b17fc346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d958ebee-5e7e-4e74-a811-3738b17fc346', 'volume_size': 1} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1089505468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d958ebee-5e7e-4e74-a811-3738b17fc346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02df6ce066a469684e9342918d900ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:38:14Z,use_quota=True,user_id='13dbb1f75f234a1dae57ff4334ba7f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Creating volume d958ebee-5e7e-4e74-a811-3738b17fc346 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:38:14 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:38:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d958ebee-5e7e-4e74-a811-3738b17fc346 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:38:14 devstack sudo[93308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d958ebee-5e7e-4e74-a811-3738b17fc346 1073741824 Nov 06 18:38:14 devstack sudo[93308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:38:15 devstack sudo[93308]: pam_unix(sudo:session): session closed for user root Nov 06 18:38:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d958ebee-5e7e-4e74-a811-3738b17fc346 1073741824" returned: 0 in 0.975s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:38:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d958ebee-5e7e-4e74-a811-3738b17fc346 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:38:15 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d958ebee-5e7e-4e74-a811-3738b17fc346 Nov 06 18:38:15 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:38:16 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Nov 06 18:38:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d958ebee-5e7e-4e74-a811-3738b17fc346" returned: 0 in 0.560s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:38:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:38:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:38:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6cc249-bf4c-4b9d-8dd9-72a5f73a064d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d958ebee-5e7e-4e74-a811-3738b17fc346', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8084cfa5-51bc-4ead-b999-d196722a1064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:16 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Volume volume-d958ebee-5e7e-4e74-a811-3738b17fc346 (d958ebee-5e7e-4e74-a811-3738b17fc346): created successfully Nov 06 18:38:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8084cfa5-51bc-4ead-b999-d196722a1064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Flow 'volume_create_manager' (37dd95bd-2153-4c69-b656-f07556f929bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:38:16 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-7bed5192-6e53-4e64-b3f3-01a0abb5bd59 tempest-VolumesTransfersV357Test-1551283526 None] Created volume successfully. Nov 06 18:38:18 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-0589b688-b3d2-431a-8987-1c30aae57dba tempest-VolumesTransfersV357Test-1161287403 None] Transfer volume completed successfully. Nov 06 18:38:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-05437a47-930a-4aa9-9c4a-a906d8aeb055 tempest-VolumesTransfersV357Test-1838991234 None] Acquiring lock "cinder-d958ebee-5e7e-4e74-a811-3738b17fc346-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:38:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-05437a47-930a-4aa9-9c4a-a906d8aeb055 tempest-VolumesTransfersV357Test-1838991234 None] Lock "cinder-d958ebee-5e7e-4e74-a811-3738b17fc346-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:38:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-05437a47-930a-4aa9-9c4a-a906d8aeb055 tempest-VolumesTransfersV357Test-1838991234 None] Acquiring lock "cinder-quobyte-d958ebee-5e7e-4e74-a811-3738b17fc346" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:38:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-05437a47-930a-4aa9-9c4a-a906d8aeb055 tempest-VolumesTransfersV357Test-1838991234 None] Lock "cinder-quobyte-d958ebee-5e7e-4e74-a811-3738b17fc346" acquired by "delete_volume" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:38:19 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[217c783a-39bc-4611-baf1-15caf744ddea]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:38:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-05437a47-930a-4aa9-9c4a-a906d8aeb055 tempest-VolumesTransfersV357Test-1838991234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d958ebee-5e7e-4e74-a811-3738b17fc346 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:38:19 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d958ebee-5e7e-4e74-a811-3738b17fc346 Nov 06 18:38:19 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:38:19 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Nov 06 18:38:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-05437a47-930a-4aa9-9c4a-a906d8aeb055 tempest-VolumesTransfersV357Test-1838991234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d958ebee-5e7e-4e74-a811-3738b17fc346" returned: 0 in 0.406s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:38:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-05437a47-930a-4aa9-9c4a-a906d8aeb055 tempest-VolumesTransfersV357Test-1838991234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d958ebee-5e7e-4e74-a811-3738b17fc346 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:38:19 devstack sudo[93342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d958ebee-5e7e-4e74-a811-3738b17fc346 Nov 06 18:38:19 devstack sudo[93342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:38:19 devstack sudo[93342]: pam_unix(sudo:session): session closed for user root Nov 06 18:38:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-05437a47-930a-4aa9-9c4a-a906d8aeb055 tempest-VolumesTransfersV357Test-1838991234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d958ebee-5e7e-4e74-a811-3738b17fc346" returned: 0 in 0.349s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:38:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-05437a47-930a-4aa9-9c4a-a906d8aeb055 tempest-VolumesTransfersV357Test-1838991234 None] Lock "cinder-quobyte-d958ebee-5e7e-4e74-a811-3738b17fc346" released by "delete_volume" :: held 0.838s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:38:20 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-05437a47-930a-4aa9-9c4a-a906d8aeb055 tempest-VolumesTransfersV357Test-1838991234 None] Created reservations ['856edc68-6d06-4479-99c4-7e150b627d32', '44ce71e8-3597-4922-a91a-cd440146a470', '324f5b4b-9a81-430e-b88e-105afbad9252', '3aff6ff9-2a97-4f52-b7c9-8fce536c4c17'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:38:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-05437a47-930a-4aa9-9c4a-a906d8aeb055 tempest-VolumesTransfersV357Test-1838991234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:38:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-05437a47-930a-4aa9-9c4a-a906d8aeb055 tempest-VolumesTransfersV357Test-1838991234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:38:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-05437a47-930a-4aa9-9c4a-a906d8aeb055 tempest-VolumesTransfersV357Test-1838991234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:38:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-05437a47-930a-4aa9-9c4a-a906d8aeb055 tempest-VolumesTransfersV357Test-1838991234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:38:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-05437a47-930a-4aa9-9c4a-a906d8aeb055 tempest-VolumesTransfersV357Test-1838991234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:38:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-05437a47-930a-4aa9-9c4a-a906d8aeb055 tempest-VolumesTransfersV357Test-1838991234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:38:20 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:38:20 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:38:20 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Nov 06 18:38:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-05437a47-930a-4aa9-9c4a-a906d8aeb055 tempest-VolumesTransfersV357Test-1838991234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.416s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:38:20 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-05437a47-930a-4aa9-9c4a-a906d8aeb055 tempest-VolumesTransfersV357Test-1838991234 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:38:20 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-05437a47-930a-4aa9-9c4a-a906d8aeb055 tempest-VolumesTransfersV357Test-1838991234 None] Deleted volume successfully. Nov 06 18:38:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-05437a47-930a-4aa9-9c4a-a906d8aeb055 tempest-VolumesTransfersV357Test-1838991234 None] Lock "cinder-d958ebee-5e7e-4e74-a811-3738b17fc346-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Flow 'volume_create_manager' (85b1af89-2e92-4a8e-bcc6-aea665ba3135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fbd6bb3-8426-4553-b046-3878640b2b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fbd6bb3-8426-4553-b046-3878640b2b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-82021113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945e3fb9-815e-4d56-8323-05f87ee14180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02df6ce066a469684e9342918d900ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:38:21Z,use_quota=True,user_id='13dbb1f75f234a1dae57ff4334ba7f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99707620-fac3-4084-a6fd-1f62ea299982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99707620-fac3-4084-a6fd-1f62ea299982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb9eeb9c-3db1-4f65-a2c7-ecba3442c996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb9eeb9c-3db1-4f65-a2c7-ecba3442c996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '945e3fb9-815e-4d56-8323-05f87ee14180', 'volume_name': 'volume-945e3fb9-815e-4d56-8323-05f87ee14180', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84357c66-6ef5-4ef5-86aa-55dfadbeb3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84357c66-6ef5-4ef5-86aa-55dfadbeb3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ace14e8-0d1d-491b-b8a1-9ac989580eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:21 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Volume 945e3fb9-815e-4d56-8323-05f87ee14180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-945e3fb9-815e-4d56-8323-05f87ee14180', 'volume_size': 1} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-82021113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945e3fb9-815e-4d56-8323-05f87ee14180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02df6ce066a469684e9342918d900ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:38:21Z,use_quota=True,user_id='13dbb1f75f234a1dae57ff4334ba7f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Creating volume 945e3fb9-815e-4d56-8323-05f87ee14180 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:38:21 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-945e3fb9-815e-4d56-8323-05f87ee14180 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:38:21 devstack sudo[93351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-945e3fb9-815e-4d56-8323-05f87ee14180 1073741824 Nov 06 18:38:21 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:38:21 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-945e3fb9-815e-4d56-8323-05f87ee14180 1073741824" returned: 0 in 0.497s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:38:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-945e3fb9-815e-4d56-8323-05f87ee14180 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:38:21 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-945e3fb9-815e-4d56-8323-05f87ee14180 Nov 06 18:38:21 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:38:22 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Nov 06 18:38:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-945e3fb9-815e-4d56-8323-05f87ee14180" returned: 0 in 0.461s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:38:22 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:38:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:38:22 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ace14e8-0d1d-491b-b8a1-9ac989580eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-945e3fb9-815e-4d56-8323-05f87ee14180', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:22 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c11fce-1958-4b9c-bbe5-b1b14ed22284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:22 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Volume volume-945e3fb9-815e-4d56-8323-05f87ee14180 (945e3fb9-815e-4d56-8323-05f87ee14180): created successfully Nov 06 18:38:22 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c11fce-1958-4b9c-bbe5-b1b14ed22284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:22 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Flow 'volume_create_manager' (85b1af89-2e92-4a8e-bcc6-aea665ba3135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:38:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-4be48a14-5664-48cf-a785-b4fadc1d3704 tempest-VolumesTransfersV357Test-1551283526 None] Created volume successfully. Nov 06 18:38:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c11c2e93-cadf-4e19-853f-071c84105d9c tempest-VolumesTransfersV357Test-1838991234 None] Acquiring lock "cinder-945e3fb9-815e-4d56-8323-05f87ee14180-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:38:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c11c2e93-cadf-4e19-853f-071c84105d9c tempest-VolumesTransfersV357Test-1838991234 None] Lock "cinder-945e3fb9-815e-4d56-8323-05f87ee14180-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:38:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c11c2e93-cadf-4e19-853f-071c84105d9c tempest-VolumesTransfersV357Test-1838991234 None] Acquiring lock "cinder-quobyte-945e3fb9-815e-4d56-8323-05f87ee14180" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:38:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c11c2e93-cadf-4e19-853f-071c84105d9c tempest-VolumesTransfersV357Test-1838991234 None] Lock "cinder-quobyte-945e3fb9-815e-4d56-8323-05f87ee14180" acquired by "delete_volume" :: waited 0.032s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:38:23 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0f90ef-3000-4c54-960c-9fda97271bc0]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:38:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c11c2e93-cadf-4e19-853f-071c84105d9c tempest-VolumesTransfersV357Test-1838991234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-945e3fb9-815e-4d56-8323-05f87ee14180 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:38:23 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-945e3fb9-815e-4d56-8323-05f87ee14180 Nov 06 18:38:23 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:38:24 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Nov 06 18:38:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c11c2e93-cadf-4e19-853f-071c84105d9c tempest-VolumesTransfersV357Test-1838991234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-945e3fb9-815e-4d56-8323-05f87ee14180" returned: 0 in 0.568s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:38:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c11c2e93-cadf-4e19-853f-071c84105d9c tempest-VolumesTransfersV357Test-1838991234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-945e3fb9-815e-4d56-8323-05f87ee14180 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:38:24 devstack sudo[93400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-945e3fb9-815e-4d56-8323-05f87ee14180 Nov 06 18:38:24 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:38:24 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root Nov 06 18:38:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c11c2e93-cadf-4e19-853f-071c84105d9c tempest-VolumesTransfersV357Test-1838991234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-945e3fb9-815e-4d56-8323-05f87ee14180" returned: 0 in 0.307s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:38:24 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c11c2e93-cadf-4e19-853f-071c84105d9c tempest-VolumesTransfersV357Test-1838991234 None] Lock "cinder-quobyte-945e3fb9-815e-4d56-8323-05f87ee14180" released by "delete_volume" :: held 0.964s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:38:24 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-c11c2e93-cadf-4e19-853f-071c84105d9c tempest-VolumesTransfersV357Test-1838991234 None] Created reservations ['224b55a8-be87-4c7b-a4b7-27bbce1af4a2', '63692c10-788a-458c-891e-d93dc3bf4652', '92c591da-e675-468a-9828-23aee264c34b', 'e778e869-45b8-43d8-8ddc-065251bc6d89'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:38:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c11c2e93-cadf-4e19-853f-071c84105d9c tempest-VolumesTransfersV357Test-1838991234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:38:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c11c2e93-cadf-4e19-853f-071c84105d9c tempest-VolumesTransfersV357Test-1838991234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:38:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c11c2e93-cadf-4e19-853f-071c84105d9c tempest-VolumesTransfersV357Test-1838991234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:38:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c11c2e93-cadf-4e19-853f-071c84105d9c tempest-VolumesTransfersV357Test-1838991234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:38:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c11c2e93-cadf-4e19-853f-071c84105d9c tempest-VolumesTransfersV357Test-1838991234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:38:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c11c2e93-cadf-4e19-853f-071c84105d9c tempest-VolumesTransfersV357Test-1838991234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:38:24 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:38:24 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:38:25 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Nov 06 18:38:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c11c2e93-cadf-4e19-853f-071c84105d9c tempest-VolumesTransfersV357Test-1838991234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.314s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:38:25 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-c11c2e93-cadf-4e19-853f-071c84105d9c tempest-VolumesTransfersV357Test-1838991234 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:38:25 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c11c2e93-cadf-4e19-853f-071c84105d9c tempest-VolumesTransfersV357Test-1838991234 None] Deleted volume successfully. Nov 06 18:38:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c11c2e93-cadf-4e19-853f-071c84105d9c tempest-VolumesTransfersV357Test-1838991234 None] Lock "cinder-945e3fb9-815e-4d56-8323-05f87ee14180-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:38:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:38:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:38:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:38:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:38:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:38:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:38:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:38:29 devstack sudo[93477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:38:29 devstack sudo[93477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:38:29 devstack sudo[93477]: pam_unix(sudo:session): session closed for user root Nov 06 18:38:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.353s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:38:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:38:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:38:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 29 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:38:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:38:34 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:UPDATE=64,cinder:SELECT=36,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:UPDATE=23,cinder:SELECT=19,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Flow 'volume_create_manager' (c3b0fe7e-582a-4814-bd50-91eabb305efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14d3d64-2b3e-4cee-868a-3083902ce867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14d3d64-2b3e-4cee-868a-3083902ce867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1582072222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f230d141-aa56-43d9-b9b7-300f22c0c696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b9d2665f1446f6a7d9906832a215c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:38:35Z,use_quota=True,user_id='db19e4f0ef3446d2ba9c8c9154187541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a5ea889-2336-4194-8e00-e755acad981d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a5ea889-2336-4194-8e00-e755acad981d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a299ea-f52d-4ad9-9b50-606abbfa5464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a299ea-f52d-4ad9-9b50-606abbfa5464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f230d141-aa56-43d9-b9b7-300f22c0c696', 'volume_name': 'volume-f230d141-aa56-43d9-b9b7-300f22c0c696', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe323f2-5c8b-419c-8192-890621da5191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe323f2-5c8b-419c-8192-890621da5191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ab95cc-b5ba-421d-97eb-84f1f1b991d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:35 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Volume f230d141-aa56-43d9-b9b7-300f22c0c696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f230d141-aa56-43d9-b9b7-300f22c0c696', 'volume_size': 1} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1582072222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f230d141-aa56-43d9-b9b7-300f22c0c696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b9d2665f1446f6a7d9906832a215c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:38:35Z,use_quota=True,user_id='db19e4f0ef3446d2ba9c8c9154187541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Creating volume f230d141-aa56-43d9-b9b7-300f22c0c696 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:38:35 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:38:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f230d141-aa56-43d9-b9b7-300f22c0c696 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:38:35 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f230d141-aa56-43d9-b9b7-300f22c0c696 1073741824 Nov 06 18:38:35 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:38:36 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Nov 06 18:38:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f230d141-aa56-43d9-b9b7-300f22c0c696 1073741824" returned: 0 in 0.772s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:38:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f230d141-aa56-43d9-b9b7-300f22c0c696 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:38:36 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f230d141-aa56-43d9-b9b7-300f22c0c696 Nov 06 18:38:36 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:38:36 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Nov 06 18:38:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f230d141-aa56-43d9-b9b7-300f22c0c696" returned: 0 in 0.334s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:38:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:38:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:38:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ab95cc-b5ba-421d-97eb-84f1f1b991d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f230d141-aa56-43d9-b9b7-300f22c0c696', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88289099-0680-4ba0-8b0c-534c4dcf891d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:36 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Volume volume-f230d141-aa56-43d9-b9b7-300f22c0c696 (f230d141-aa56-43d9-b9b7-300f22c0c696): created successfully Nov 06 18:38:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88289099-0680-4ba0-8b0c-534c4dcf891d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Flow 'volume_create_manager' (c3b0fe7e-582a-4814-bd50-91eabb305efc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:38:36 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-35df30e7-2b19-4bfe-bc76-c63de94a9633 tempest-AttachVolumeTestJSON-901828419 None] Created volume successfully. Nov 06 18:38:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-6fdb7078-446a-43bb-a764-680d0c4cbcbc req-db7b0c21-990d-4fad-b838-3579114816f7 tempest-AttachVolumeTestJSON-901828419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:38:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-6fdb7078-446a-43bb-a764-680d0c4cbcbc req-db7b0c21-990d-4fad-b838-3579114816f7 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:38:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-6fdb7078-446a-43bb-a764-680d0c4cbcbc req-db7b0c21-990d-4fad-b838-3579114816f7 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:38:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-6fdb7078-446a-43bb-a764-680d0c4cbcbc req-db7b0c21-990d-4fad-b838-3579114816f7 tempest-AttachVolumeTestJSON-901828419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-f230d141-aa56-43d9-b9b7-300f22c0c696', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ffe2f6a0-bcc8-4adf-a90c-1084f6131288', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:38:38 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-6fdb7078-446a-43bb-a764-680d0c4cbcbc req-db7b0c21-990d-4fad-b838-3579114816f7 tempest-AttachVolumeTestJSON-901828419 None] attachment_update completed successfully. Nov 06 18:38:48 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:38:48 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:UPDATE=7,cinder:SELECT=7 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Flow 'volume_create_manager' (77113f70-9e05-4a57-b70a-6ee01350e547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df64e396-54a7-4228-864a-32e5877761d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df64e396-54a7-4228-864a-32e5877761d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1202574707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4051cc61-cbd6-4096-9770-8184096713cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9de816e2dab4c9582471b138cb0f5b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:38:51Z,use_quota=True,user_id='73ffc73ce968421295b6a0631bd1b85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77cb538-7e76-4d07-b178-488781a1a35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77cb538-7e76-4d07-b178-488781a1a35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae68a669-28c7-4234-b1f3-08f8836ea398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae68a669-28c7-4234-b1f3-08f8836ea398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4051cc61-cbd6-4096-9770-8184096713cf', 'volume_name': 'volume-4051cc61-cbd6-4096-9770-8184096713cf', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4ee400-e77f-4c6a-ac17-e78fd34ec934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4ee400-e77f-4c6a-ac17-e78fd34ec934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fc155d-e669-4783-a9a8-74bd16fe5b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:50 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Volume 4051cc61-cbd6-4096-9770-8184096713cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4051cc61-cbd6-4096-9770-8184096713cf', 'volume_size': 1} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1202574707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4051cc61-cbd6-4096-9770-8184096713cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9de816e2dab4c9582471b138cb0f5b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:38:51Z,use_quota=True,user_id='73ffc73ce968421295b6a0631bd1b85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Creating volume 4051cc61-cbd6-4096-9770-8184096713cf {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:38:50 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:38:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:38:50 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf 1073741824 Nov 06 18:38:50 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:38:51 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Nov 06 18:38:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf 1073741824" returned: 0 in 0.736s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:38:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:38:51 devstack sudo[94544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf Nov 06 18:38:51 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:38:51 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root Nov 06 18:38:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf" returned: 0 in 0.304s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:38:51 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:38:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:38:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fc155d-e669-4783-a9a8-74bd16fe5b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4051cc61-cbd6-4096-9770-8184096713cf', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80950786-e01f-4039-94a1-183b3dc6389c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:51 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Volume volume-4051cc61-cbd6-4096-9770-8184096713cf (4051cc61-cbd6-4096-9770-8184096713cf): created successfully Nov 06 18:38:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80950786-e01f-4039-94a1-183b3dc6389c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Flow 'volume_create_manager' (77113f70-9e05-4a57-b70a-6ee01350e547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:38:51 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-383b5f01-9afa-40ee-9f0e-e6d3b968f79c tempest-VolumesActionsTest-550889764 None] Created volume successfully. Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Flow 'volume_create_manager' (d06dc8a7-9d41-428e-9381-49ac124ab590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddede3f-a7f4-4667-b05f-cfc772a4c593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddede3f-a7f4-4667-b05f-cfc772a4c593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-546008988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39dbe0b6-436f-4647-934d-9ec905586e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f001f7a424499ba4f620e8a7701487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:38:53Z,use_quota=True,user_id='964faefa0d0543ae9f3e6acb88b861fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b633ea-a4c9-4b5a-96bc-654f10887c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b633ea-a4c9-4b5a-96bc-654f10887c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8a3e66-1d50-4095-a968-c6596ada683a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8a3e66-1d50-4095-a968-c6596ada683a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39dbe0b6-436f-4647-934d-9ec905586e53', 'volume_name': 'volume-39dbe0b6-436f-4647-934d-9ec905586e53', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3a9205-a6e9-4d94-8815-8b19ac4e2a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3a9205-a6e9-4d94-8815-8b19ac4e2a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff6e86f-f7ce-4594-90bc-16805c424548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:53 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Volume 39dbe0b6-436f-4647-934d-9ec905586e53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39dbe0b6-436f-4647-934d-9ec905586e53', 'volume_size': 1} Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-546008988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39dbe0b6-436f-4647-934d-9ec905586e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f001f7a424499ba4f620e8a7701487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:38:53Z,use_quota=True,user_id='964faefa0d0543ae9f3e6acb88b861fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Creating volume 39dbe0b6-436f-4647-934d-9ec905586e53 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:38:53 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:38:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-39dbe0b6-436f-4647-934d-9ec905586e53 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:38:53 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-39dbe0b6-436f-4647-934d-9ec905586e53 1073741824 Nov 06 18:38:53 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:38:54 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Nov 06 18:38:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-39dbe0b6-436f-4647-934d-9ec905586e53 1073741824" returned: 0 in 0.637s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:38:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-39dbe0b6-436f-4647-934d-9ec905586e53 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:38:54 devstack sudo[94559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-39dbe0b6-436f-4647-934d-9ec905586e53 Nov 06 18:38:54 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:38:54 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root Nov 06 18:38:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-39dbe0b6-436f-4647-934d-9ec905586e53" returned: 0 in 0.327s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:38:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:38:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:38:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff6e86f-f7ce-4594-90bc-16805c424548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39dbe0b6-436f-4647-934d-9ec905586e53', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8b45b4-fe71-4c0a-8b50-a890f883add8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:38:54 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Volume volume-39dbe0b6-436f-4647-934d-9ec905586e53 (39dbe0b6-436f-4647-934d-9ec905586e53): created successfully Nov 06 18:38:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8b45b4-fe71-4c0a-8b50-a890f883add8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:38:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Flow 'volume_create_manager' (d06dc8a7-9d41-428e-9381-49ac124ab590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:38:54 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-b741d0ed-d21c-4b9d-91a3-9393afe24203 tempest-AttachVolumeNegativeTest-672322174 None] Created volume successfully. Nov 06 18:38:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-d17e9db8-3b3e-4c75-94a2-b0b9197fe211 req-25acf401-a13e-4eb5-bd10-3c42aa8b1835 tempest-AttachVolumeNegativeTest-672322174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:38:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-d17e9db8-3b3e-4c75-94a2-b0b9197fe211 req-25acf401-a13e-4eb5-bd10-3c42aa8b1835 tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:38:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-d17e9db8-3b3e-4c75-94a2-b0b9197fe211 req-25acf401-a13e-4eb5-bd10-3c42aa8b1835 tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:38:57 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-d17e9db8-3b3e-4c75-94a2-b0b9197fe211 req-25acf401-a13e-4eb5-bd10-3c42aa8b1835 tempest-AttachVolumeNegativeTest-672322174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-39dbe0b6-436f-4647-934d-9ec905586e53', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c14a2581-d89e-451c-a96e-20e9c9309328', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:38:57 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-d17e9db8-3b3e-4c75-94a2-b0b9197fe211 req-25acf401-a13e-4eb5-bd10-3c42aa8b1835 tempest-AttachVolumeNegativeTest-672322174 None] attachment_update completed successfully. Nov 06 18:39:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-17aa5666-52ea-475e-9983-81a54079c3e7 tempest-VolumesActionsTest-550889764 None] Acquiring lock "cinder-4051cc61-cbd6-4096-9770-8184096713cf" by "attach_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:39:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-17aa5666-52ea-475e-9983-81a54079c3e7 tempest-VolumesActionsTest-550889764 None] Lock "cinder-4051cc61-cbd6-4096-9770-8184096713cf" acquired by "attach_volume" :: waited 0.025s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:39:03 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-17aa5666-52ea-475e-9983-81a54079c3e7 tempest-VolumesActionsTest-550889764 None] Attaching volume 4051cc61-cbd6-4096-9770-8184096713cf to instance 273de852-da67-450f-8a9d-29e456d24261 at mountpoint /dev/vdb on host None. Nov 06 18:39:03 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-17aa5666-52ea-475e-9983-81a54079c3e7 tempest-VolumesActionsTest-550889764 None] Attach volume completed successfully. Nov 06 18:39:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-17aa5666-52ea-475e-9983-81a54079c3e7 tempest-VolumesActionsTest-550889764 None] Lock "cinder-4051cc61-cbd6-4096-9770-8184096713cf" released by "attach_volume" :: held 0.146s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:39:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f8e4925f-6017-4449-b680-693fc072d0b1 tempest-VolumesActionsTest-550889764 None] Acquiring lock "cinder-4051cc61-cbd6-4096-9770-8184096713cf-detach_volume" by "detach_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:39:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f8e4925f-6017-4449-b680-693fc072d0b1 tempest-VolumesActionsTest-550889764 None] Lock "cinder-4051cc61-cbd6-4096-9770-8184096713cf-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:39:03 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-f8e4925f-6017-4449-b680-693fc072d0b1 tempest-VolumesActionsTest-550889764 None] Detaching volume 4051cc61-cbd6-4096-9770-8184096713cf from instance 273de852-da67-450f-8a9d-29e456d24261. Nov 06 18:39:03 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-f8e4925f-6017-4449-b680-693fc072d0b1 tempest-VolumesActionsTest-550889764 None] Detach volume completed successfully. Nov 06 18:39:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f8e4925f-6017-4449-b680-693fc072d0b1 tempest-VolumesActionsTest-550889764 None] Lock "cinder-4051cc61-cbd6-4096-9770-8184096713cf-detach_volume" released by "detach_volume" :: held 0.109s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Flow 'volume_create_manager' (ad9d7920-0ec5-4ea0-9d95-40e953916341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b3e422-4f50-4bd7-a505-763f0516de73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b3e422-4f50-4bd7-a505-763f0516de73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-243258733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a61f982-8750-4315-b364-2f247580c2b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422ca53efa9c432c950f1c5625ef0643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:39:08Z,use_quota=True,user_id='939efbd7e02c40aea8592e91f282c1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3edaa894-ee8a-4add-90d1-000edb41848b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3edaa894-ee8a-4add-90d1-000edb41848b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa265003-e1f0-40b0-b418-7438b36ce229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa265003-e1f0-40b0-b418-7438b36ce229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a61f982-8750-4315-b364-2f247580c2b4', 'volume_name': 'volume-3a61f982-8750-4315-b364-2f247580c2b4', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf2e0d3-59db-4d18-a2cb-ec3998e4b224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf2e0d3-59db-4d18-a2cb-ec3998e4b224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe76cdd-4db3-4e5c-a774-852b2102da83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:39:08 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Volume 3a61f982-8750-4315-b364-2f247580c2b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a61f982-8750-4315-b364-2f247580c2b4', 'volume_size': 1} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-243258733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a61f982-8750-4315-b364-2f247580c2b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422ca53efa9c432c950f1c5625ef0643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:39:08Z,use_quota=True,user_id='939efbd7e02c40aea8592e91f282c1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Creating volume 3a61f982-8750-4315-b364-2f247580c2b4 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:39:08 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:39:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3a61f982-8750-4315-b364-2f247580c2b4 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:39:08 devstack sudo[94748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3a61f982-8750-4315-b364-2f247580c2b4 1073741824 Nov 06 18:39:08 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:39:09 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root Nov 06 18:39:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3a61f982-8750-4315-b364-2f247580c2b4 1073741824" returned: 0 in 0.523s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:39:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3a61f982-8750-4315-b364-2f247580c2b4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:39:09 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3a61f982-8750-4315-b364-2f247580c2b4 Nov 06 18:39:09 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:39:09 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Nov 06 18:39:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3a61f982-8750-4315-b364-2f247580c2b4" returned: 0 in 0.315s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:39:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:39:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:39:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe76cdd-4db3-4e5c-a774-852b2102da83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a61f982-8750-4315-b364-2f247580c2b4', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:39:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de5eeaf4-5319-421b-a21a-369a7400edf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:39:09 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Volume volume-3a61f982-8750-4315-b364-2f247580c2b4 (3a61f982-8750-4315-b364-2f247580c2b4): created successfully Nov 06 18:39:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de5eeaf4-5319-421b-a21a-369a7400edf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:39:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Flow 'volume_create_manager' (ad9d7920-0ec5-4ea0-9d95-40e953916341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:39:09 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-127f118a-4cf0-4049-9eaa-860512a45f5d tempest-VolumeQuotasAdminTestJSON-486421599 None] Created volume successfully. Nov 06 18:39:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ebd32e7a-d6f0-4ced-af9b-174daeb76ba4 tempest-VolumeQuotasAdminTestJSON-486421599 None] Acquiring lock "cinder-3a61f982-8750-4315-b364-2f247580c2b4-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:39:11 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ebd32e7a-d6f0-4ced-af9b-174daeb76ba4 tempest-VolumeQuotasAdminTestJSON-486421599 None] Lock "cinder-3a61f982-8750-4315-b364-2f247580c2b4-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:39:11 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ebd32e7a-d6f0-4ced-af9b-174daeb76ba4 tempest-VolumeQuotasAdminTestJSON-486421599 None] Acquiring lock "cinder-quobyte-3a61f982-8750-4315-b364-2f247580c2b4" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:39:11 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ebd32e7a-d6f0-4ced-af9b-174daeb76ba4 tempest-VolumeQuotasAdminTestJSON-486421599 None] Lock "cinder-quobyte-3a61f982-8750-4315-b364-2f247580c2b4" acquired by "delete_volume" :: waited 0.030s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:39:11 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b623c1b-1d7a-4e50-931e-8d0c4b23765a]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:39:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ebd32e7a-d6f0-4ced-af9b-174daeb76ba4 tempest-VolumeQuotasAdminTestJSON-486421599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3a61f982-8750-4315-b364-2f247580c2b4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:39:11 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3a61f982-8750-4315-b364-2f247580c2b4 Nov 06 18:39:11 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:39:12 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Nov 06 18:39:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ebd32e7a-d6f0-4ced-af9b-174daeb76ba4 tempest-VolumeQuotasAdminTestJSON-486421599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3a61f982-8750-4315-b364-2f247580c2b4" returned: 0 in 0.810s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:39:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ebd32e7a-d6f0-4ced-af9b-174daeb76ba4 tempest-VolumeQuotasAdminTestJSON-486421599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3a61f982-8750-4315-b364-2f247580c2b4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:39:12 devstack sudo[94822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3a61f982-8750-4315-b364-2f247580c2b4 Nov 06 18:39:12 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:39:12 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root Nov 06 18:39:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ebd32e7a-d6f0-4ced-af9b-174daeb76ba4 tempest-VolumeQuotasAdminTestJSON-486421599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3a61f982-8750-4315-b364-2f247580c2b4" returned: 0 in 0.290s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:39:12 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ebd32e7a-d6f0-4ced-af9b-174daeb76ba4 tempest-VolumeQuotasAdminTestJSON-486421599 None] Lock "cinder-quobyte-3a61f982-8750-4315-b364-2f247580c2b4" released by "delete_volume" :: held 1.221s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:39:12 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-ebd32e7a-d6f0-4ced-af9b-174daeb76ba4 tempest-VolumeQuotasAdminTestJSON-486421599 None] Created reservations ['81e381ae-a0ae-4f60-89e6-897c09f287df', '74e42aaa-f2c4-4f74-87b5-eceb2b1336ac', 'ee453309-db2f-4f57-8bd7-39436460e7ba', '365d14ba-3698-4710-a119-e13e261d8acb'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:39:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ebd32e7a-d6f0-4ced-af9b-174daeb76ba4 tempest-VolumeQuotasAdminTestJSON-486421599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:39:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ebd32e7a-d6f0-4ced-af9b-174daeb76ba4 tempest-VolumeQuotasAdminTestJSON-486421599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:39:12 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ebd32e7a-d6f0-4ced-af9b-174daeb76ba4 tempest-VolumeQuotasAdminTestJSON-486421599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:39:12 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ebd32e7a-d6f0-4ced-af9b-174daeb76ba4 tempest-VolumeQuotasAdminTestJSON-486421599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:39:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ebd32e7a-d6f0-4ced-af9b-174daeb76ba4 tempest-VolumeQuotasAdminTestJSON-486421599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:39:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ebd32e7a-d6f0-4ced-af9b-174daeb76ba4 tempest-VolumeQuotasAdminTestJSON-486421599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:39:12 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:39:12 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:39:13 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Nov 06 18:39:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ebd32e7a-d6f0-4ced-af9b-174daeb76ba4 tempest-VolumeQuotasAdminTestJSON-486421599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.541s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:39:13 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-ebd32e7a-d6f0-4ced-af9b-174daeb76ba4 tempest-VolumeQuotasAdminTestJSON-486421599 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:39:13 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-ebd32e7a-d6f0-4ced-af9b-174daeb76ba4 tempest-VolumeQuotasAdminTestJSON-486421599 None] Deleted volume successfully. Nov 06 18:39:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ebd32e7a-d6f0-4ced-af9b-174daeb76ba4 tempest-VolumeQuotasAdminTestJSON-486421599 None] Lock "cinder-3a61f982-8750-4315-b364-2f247580c2b4-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:39:13 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-69d626e1-d26f-44e5-abb4-6ff62766e313 req-fde895fb-c17e-4d01-abdb-b6f0c3bbc38c tempest-AttachVolumeTestJSON-901828419 None] Terminate volume connection completed successfully. Nov 06 18:39:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-69d626e1-d26f-44e5-abb4-6ff62766e313 req-fde895fb-c17e-4d01-abdb-b6f0c3bbc38c tempest-AttachVolumeTestJSON-901828419 None] Deleting attachment ffe2f6a0-bcc8-4adf-a90c-1084f6131288. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Flow 'volume_create_manager' (52e401cc-2934-4ce0-a801-b3a135f11165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf094ebd-3f08-4f2d-ac80-b9f55d93662d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf094ebd-3f08-4f2d-ac80-b9f55d93662d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1794047707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2218313-dbeb-4f58-be5e-cf5528003677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422ca53efa9c432c950f1c5625ef0643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:39:14Z,use_quota=True,user_id='939efbd7e02c40aea8592e91f282c1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a68df4-9768-41cf-8815-ecb473a73518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a68df4-9768-41cf-8815-ecb473a73518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60069438-06b7-4a79-bf9e-2bc24df57ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60069438-06b7-4a79-bf9e-2bc24df57ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2218313-dbeb-4f58-be5e-cf5528003677', 'volume_name': 'volume-e2218313-dbeb-4f58-be5e-cf5528003677', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ab6b11-831c-4237-be26-87eaa2e47771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ab6b11-831c-4237-be26-87eaa2e47771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964ffbf4-80b6-477f-888d-9251c12df048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:39:14 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Volume e2218313-dbeb-4f58-be5e-cf5528003677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2218313-dbeb-4f58-be5e-cf5528003677', 'volume_size': 1} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1794047707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2218313-dbeb-4f58-be5e-cf5528003677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422ca53efa9c432c950f1c5625ef0643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:39:14Z,use_quota=True,user_id='939efbd7e02c40aea8592e91f282c1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Creating volume e2218313-dbeb-4f58-be5e-cf5528003677 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:39:14 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:39:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2218313-dbeb-4f58-be5e-cf5528003677 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:39:14 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2218313-dbeb-4f58-be5e-cf5528003677 1073741824 Nov 06 18:39:14 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:39:15 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Nov 06 18:39:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2218313-dbeb-4f58-be5e-cf5528003677 1073741824" returned: 0 in 0.910s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:39:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2218313-dbeb-4f58-be5e-cf5528003677 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:39:15 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2218313-dbeb-4f58-be5e-cf5528003677 Nov 06 18:39:15 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:39:16 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Nov 06 18:39:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2218313-dbeb-4f58-be5e-cf5528003677" returned: 0 in 0.715s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:39:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:39:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:39:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964ffbf4-80b6-477f-888d-9251c12df048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2218313-dbeb-4f58-be5e-cf5528003677', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:39:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9015bec-2315-43d3-ab98-60a1b667a993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:39:16 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Volume volume-e2218313-dbeb-4f58-be5e-cf5528003677 (e2218313-dbeb-4f58-be5e-cf5528003677): created successfully Nov 06 18:39:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9015bec-2315-43d3-ab98-60a1b667a993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:39:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Flow 'volume_create_manager' (52e401cc-2934-4ce0-a801-b3a135f11165) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:39:16 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-9f17d671-f9ed-49c6-8d30-31510d11dccc tempest-VolumeQuotasAdminTestJSON-486421599 None] Created volume successfully. Nov 06 18:39:17 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-121f343c-fe6f-4a50-8683-dee0f0a181e6 tempest-VolumeQuotasAdminTestJSON-1649334029 None] Transfer volume completed successfully. Nov 06 18:39:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-27d32e43-f0e4-4024-9223-0a4aa7b6d9e1 tempest-VolumeQuotasAdminTestJSON-1644310393 None] Acquiring lock "cinder-e2218313-dbeb-4f58-be5e-cf5528003677-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:39:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-27d32e43-f0e4-4024-9223-0a4aa7b6d9e1 tempest-VolumeQuotasAdminTestJSON-1644310393 None] Lock "cinder-e2218313-dbeb-4f58-be5e-cf5528003677-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:39:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-27d32e43-f0e4-4024-9223-0a4aa7b6d9e1 tempest-VolumeQuotasAdminTestJSON-1644310393 None] Acquiring lock "cinder-quobyte-e2218313-dbeb-4f58-be5e-cf5528003677" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:39:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-27d32e43-f0e4-4024-9223-0a4aa7b6d9e1 tempest-VolumeQuotasAdminTestJSON-1644310393 None] Lock "cinder-quobyte-e2218313-dbeb-4f58-be5e-cf5528003677" acquired by "delete_volume" :: waited 0.049s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:39:19 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e9dd35-7912-4c56-b0ad-96d51d3ee0fe]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:39:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-27d32e43-f0e4-4024-9223-0a4aa7b6d9e1 tempest-VolumeQuotasAdminTestJSON-1644310393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2218313-dbeb-4f58-be5e-cf5528003677 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:39:19 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2218313-dbeb-4f58-be5e-cf5528003677 Nov 06 18:39:19 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:39:20 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Nov 06 18:39:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-27d32e43-f0e4-4024-9223-0a4aa7b6d9e1 tempest-VolumeQuotasAdminTestJSON-1644310393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2218313-dbeb-4f58-be5e-cf5528003677" returned: 0 in 1.175s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:39:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-27d32e43-f0e4-4024-9223-0a4aa7b6d9e1 tempest-VolumeQuotasAdminTestJSON-1644310393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2218313-dbeb-4f58-be5e-cf5528003677 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:39:20 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2218313-dbeb-4f58-be5e-cf5528003677 Nov 06 18:39:20 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:39:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a590d927-4de2-4727-bf05-823a8511ab39 tempest-VolumesActionsTest-550889764 None] Acquiring lock "cinder-4051cc61-cbd6-4096-9770-8184096713cf" by "attach_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:39:20 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Nov 06 18:39:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-27d32e43-f0e4-4024-9223-0a4aa7b6d9e1 tempest-VolumeQuotasAdminTestJSON-1644310393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2218313-dbeb-4f58-be5e-cf5528003677" returned: 0 in 0.466s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:39:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a590d927-4de2-4727-bf05-823a8511ab39 tempest-VolumesActionsTest-550889764 None] Lock "cinder-4051cc61-cbd6-4096-9770-8184096713cf" acquired by "attach_volume" :: waited 0.053s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:39:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-27d32e43-f0e4-4024-9223-0a4aa7b6d9e1 tempest-VolumeQuotasAdminTestJSON-1644310393 None] Lock "cinder-quobyte-e2218313-dbeb-4f58-be5e-cf5528003677" released by "delete_volume" :: held 1.787s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:39:20 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-27d32e43-f0e4-4024-9223-0a4aa7b6d9e1 tempest-VolumeQuotasAdminTestJSON-1644310393 None] Created reservations ['9fd7e29c-f54a-4170-afca-04eed3179869', '824bf6f1-5037-4323-baf6-04b7507856ce', '44b50472-3f7a-4411-b291-d9f3b8c6ddec', 'fe8c0f11-a262-43c0-8b74-5a424dc9056c'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:39:21 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a590d927-4de2-4727-bf05-823a8511ab39 tempest-VolumesActionsTest-550889764 None] Attaching volume 4051cc61-cbd6-4096-9770-8184096713cf to instance aa7fbd60-4939-4370-ab17-30545a043fbe at mountpoint /dev/vdb on host None. Nov 06 18:39:21 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a590d927-4de2-4727-bf05-823a8511ab39 tempest-VolumesActionsTest-550889764 None] Attach volume completed successfully. Nov 06 18:39:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a590d927-4de2-4727-bf05-823a8511ab39 tempest-VolumesActionsTest-550889764 None] Lock "cinder-4051cc61-cbd6-4096-9770-8184096713cf" released by "attach_volume" :: held 0.253s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:39:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-27d32e43-f0e4-4024-9223-0a4aa7b6d9e1 tempest-VolumeQuotasAdminTestJSON-1644310393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:39:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-27d32e43-f0e4-4024-9223-0a4aa7b6d9e1 tempest-VolumeQuotasAdminTestJSON-1644310393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:39:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-27d32e43-f0e4-4024-9223-0a4aa7b6d9e1 tempest-VolumeQuotasAdminTestJSON-1644310393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:39:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-27d32e43-f0e4-4024-9223-0a4aa7b6d9e1 tempest-VolumeQuotasAdminTestJSON-1644310393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:39:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-27d32e43-f0e4-4024-9223-0a4aa7b6d9e1 tempest-VolumeQuotasAdminTestJSON-1644310393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:39:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-27d32e43-f0e4-4024-9223-0a4aa7b6d9e1 tempest-VolumeQuotasAdminTestJSON-1644310393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:39:21 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:39:21 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:39:22 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Nov 06 18:39:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-27d32e43-f0e4-4024-9223-0a4aa7b6d9e1 tempest-VolumeQuotasAdminTestJSON-1644310393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.918s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:39:22 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-27d32e43-f0e4-4024-9223-0a4aa7b6d9e1 tempest-VolumeQuotasAdminTestJSON-1644310393 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:39:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-27d32e43-f0e4-4024-9223-0a4aa7b6d9e1 tempest-VolumeQuotasAdminTestJSON-1644310393 None] Deleted volume successfully. Nov 06 18:39:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-27d32e43-f0e4-4024-9223-0a4aa7b6d9e1 tempest-VolumeQuotasAdminTestJSON-1644310393 None] Lock "cinder-e2218313-dbeb-4f58-be5e-cf5528003677-delete_volume" released by "delete_volume" :: held 3.285s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:39:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-39cefd57-1b4d-4f22-af48-c1942290cfb7 tempest-VolumesActionsTest-550889764 None] Acquiring lock "cinder-4051cc61-cbd6-4096-9770-8184096713cf-detach_volume" by "detach_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:39:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-39cefd57-1b4d-4f22-af48-c1942290cfb7 tempest-VolumesActionsTest-550889764 None] Lock "cinder-4051cc61-cbd6-4096-9770-8184096713cf-detach_volume" acquired by "detach_volume" :: waited 0.058s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:39:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-39cefd57-1b4d-4f22-af48-c1942290cfb7 tempest-VolumesActionsTest-550889764 None] Detaching volume 4051cc61-cbd6-4096-9770-8184096713cf from instance aa7fbd60-4939-4370-ab17-30545a043fbe. Nov 06 18:39:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-39cefd57-1b4d-4f22-af48-c1942290cfb7 tempest-VolumesActionsTest-550889764 None] Detach volume completed successfully. Nov 06 18:39:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-39cefd57-1b4d-4f22-af48-c1942290cfb7 tempest-VolumesActionsTest-550889764 None] Lock "cinder-4051cc61-cbd6-4096-9770-8184096713cf-detach_volume" released by "detach_volume" :: held 0.214s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:39:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:39:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:39:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:39:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:39:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:39:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:39:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:39:29 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:39:29 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:39:29 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Nov 06 18:39:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.302s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:39:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:39:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:39:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 29 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:39:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:39:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9396f33d-5737-4e79-a4b1-3d8343b4a0cb tempest-VolumesActionsTest-550889764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:39:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9396f33d-5737-4e79-a4b1-3d8343b4a0cb tempest-VolumesActionsTest-550889764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:39:31 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e106076-d695-4072-a4a8-8c61b26fb8a5]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:39:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9396f33d-5737-4e79-a4b1-3d8343b4a0cb tempest-VolumesActionsTest-550889764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:39:31 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf Nov 06 18:39:31 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:39:32 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Nov 06 18:39:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9396f33d-5737-4e79-a4b1-3d8343b4a0cb tempest-VolumesActionsTest-550889764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf" returned: 0 in 0.418s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:39:32 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac0cabe-6bc3-4785-8cf4-ee07f72e005b]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:39:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9396f33d-5737-4e79-a4b1-3d8343b4a0cb tempest-VolumesActionsTest-550889764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:39:32 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf Nov 06 18:39:32 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:39:32 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Nov 06 18:39:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9396f33d-5737-4e79-a4b1-3d8343b4a0cb tempest-VolumesActionsTest-550889764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf" returned: 0 in 0.412s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:39:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9396f33d-5737-4e79-a4b1-3d8343b4a0cb tempest-VolumesActionsTest-550889764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf /opt/stack/data/cinder/conversion/4051cc61-cbd6-4096-9770-8184096713cf.temp_image.c14eb1bd-3af2-4ad2-9e20-47bb760aacf3wbr63nbj.img {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:39:32 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf /opt/stack/data/cinder/conversion/4051cc61-cbd6-4096-9770-8184096713cf.temp_image.c14eb1bd-3af2-4ad2-9e20-47bb760aacf3wbr63nbj.img Nov 06 18:39:32 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:39:32 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:UPDATE=39,cinder:SELECT=39,cinder:INSERT=8,cinder:DELETE=4 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:39:41 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=40,cinder:UPDATE=32,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:39:42 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Nov 06 18:39:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9396f33d-5737-4e79-a4b1-3d8343b4a0cb tempest-VolumesActionsTest-550889764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf /opt/stack/data/cinder/conversion/4051cc61-cbd6-4096-9770-8184096713cf.temp_image.c14eb1bd-3af2-4ad2-9e20-47bb760aacf3wbr63nbj.img" returned: 0 in 10.061s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:39:42 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f275b0-64cd-416a-9947-8c16ee676578]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:39:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9396f33d-5737-4e79-a4b1-3d8343b4a0cb tempest-VolumesActionsTest-550889764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:39:42 devstack sudo[95218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf Nov 06 18:39:42 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:39:43 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root Nov 06 18:39:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9396f33d-5737-4e79-a4b1-3d8343b4a0cb tempest-VolumesActionsTest-550889764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf" returned: 0 in 0.568s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:39:43 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-9396f33d-5737-4e79-a4b1-3d8343b4a0cb tempest-VolumesActionsTest-550889764 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf, size 1024.00 MB, duration 10.06 sec, destination /opt/stack/data/cinder/conversion/4051cc61-cbd6-4096-9770-8184096713cf.temp_image.c14eb1bd-3af2-4ad2-9e20-47bb760aacf3wbr63nbj.img {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:39:43 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-9396f33d-5737-4e79-a4b1-3d8343b4a0cb tempest-VolumesActionsTest-550889764 None] Converted 1024.00 MB image at 101.77 MB/s Nov 06 18:39:43 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-9396f33d-5737-4e79-a4b1-3d8343b4a0cb tempest-VolumesActionsTest-550889764 None] c14eb1bd-3af2-4ad2-9e20-47bb760aacf3 was raw, no need to convert to raw {{(pid=86794) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1180}} Nov 06 18:39:44 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-b1fa89cd-693c-4249-b6d9-763430307f82 req-2e906813-ef48-4d22-827a-8dcf67273449 tempest-AttachVolumeNegativeTest-672322174 None] Terminate volume connection completed successfully. Nov 06 18:39:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-b1fa89cd-693c-4249-b6d9-763430307f82 req-2e906813-ef48-4d22-827a-8dcf67273449 tempest-AttachVolumeNegativeTest-672322174 None] Deleting attachment c14a2581-d89e-451c-a96e-20e9c9309328. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:39:54 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=2 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:39:54 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=2 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:40:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9396f33d-5737-4e79-a4b1-3d8343b4a0cb tempest-VolumesActionsTest-550889764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 41.239s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9396f33d-5737-4e79-a4b1-3d8343b4a0cb tempest-VolumesActionsTest-550889764 None] Uploaded volume to glance image-id: c14eb1bd-3af2-4ad2-9e20-47bb760aacf3. {{(pid=86794) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 18:40:12 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-9396f33d-5737-4e79-a4b1-3d8343b4a0cb tempest-VolumesActionsTest-550889764 None] Copy volume to image completed successfully. Nov 06 18:40:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:15 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[58feabe0-8a95-4174-90df-c08ce48f51aa]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:40:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:15 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf Nov 06 18:40:15 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:15 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf" returned: 0 in 0.615s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:15 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[081d28b5-af42-4acf-bc7b-dc8d11f9e48e]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:40:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:16 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf Nov 06 18:40:16 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:16 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf" returned: 0 in 0.472s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf /opt/stack/data/cinder/conversion/4051cc61-cbd6-4096-9770-8184096713cf.temp_image.8a08361d-1018-431b-aba1-c59032e87f73a5_ivwxa.img {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:16 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf /opt/stack/data/cinder/conversion/4051cc61-cbd6-4096-9770-8184096713cf.temp_image.8a08361d-1018-431b-aba1-c59032e87f73a5_ivwxa.img Nov 06 18:40:16 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:28 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:40:28 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:40:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:40:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:40:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:40:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:29 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:40:29 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:29 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf /opt/stack/data/cinder/conversion/4051cc61-cbd6-4096-9770-8184096713cf.temp_image.8a08361d-1018-431b-aba1-c59032e87f73a5_ivwxa.img" returned: 0 in 12.902s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:29 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[294ad04c-264b-4c42-859f-34db4c2449e5]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:40:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:29 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf Nov 06 18:40:29 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:29 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.560s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:40:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:40:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 29 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:40:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:40:30 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf" returned: 0 in 0.790s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:30 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf, size 1024.00 MB, duration 12.90 sec, destination /opt/stack/data/cinder/conversion/4051cc61-cbd6-4096-9770-8184096713cf.temp_image.8a08361d-1018-431b-aba1-c59032e87f73a5_ivwxa.img {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:40:30 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] Converted 1024.00 MB image at 79.36 MB/s Nov 06 18:40:30 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] 8a08361d-1018-431b-aba1-c59032e87f73 was raw, converting to qcow2 {{(pid=86794) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1197}} Nov 06 18:40:30 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdb73f7-be7a-4a2d-8d72-148a7c654e69]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:40:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4051cc61-cbd6-4096-9770-8184096713cf.temp_image.8a08361d-1018-431b-aba1-c59032e87f73a5_ivwxa.img {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:30 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4051cc61-cbd6-4096-9770-8184096713cf.temp_image.8a08361d-1018-431b-aba1-c59032e87f73a5_ivwxa.img Nov 06 18:40:30 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:30 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4051cc61-cbd6-4096-9770-8184096713cf.temp_image.8a08361d-1018-431b-aba1-c59032e87f73a5_ivwxa.img" returned: 0 in 0.521s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4051cc61-cbd6-4096-9770-8184096713cf.temp_image.8a08361d-1018-431b-aba1-c59032e87f73a5_ivwxa.img {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:30 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4051cc61-cbd6-4096-9770-8184096713cf.temp_image.8a08361d-1018-431b-aba1-c59032e87f73a5_ivwxa.img Nov 06 18:40:30 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:31 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4051cc61-cbd6-4096-9770-8184096713cf.temp_image.8a08361d-1018-431b-aba1-c59032e87f73a5_ivwxa.img" returned: 1 in 0.453s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4051cc61-cbd6-4096-9770-8184096713cf.temp_image.8a08361d-1018-431b-aba1-c59032e87f73a5_ivwxa.img' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:40:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4051cc61-cbd6-4096-9770-8184096713cf.temp_image.8a08361d-1018-431b-aba1-c59032e87f73a5_ivwxa.img /opt/stack/data/cinder/conversion/vol_upload_4nrmrhzy {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:31 devstack sudo[95581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4051cc61-cbd6-4096-9770-8184096713cf.temp_image.8a08361d-1018-431b-aba1-c59032e87f73a5_ivwxa.img /opt/stack/data/cinder/conversion/vol_upload_4nrmrhzy Nov 06 18:40:31 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:31 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4051cc61-cbd6-4096-9770-8184096713cf.temp_image.8a08361d-1018-431b-aba1-c59032e87f73a5_ivwxa.img /opt/stack/data/cinder/conversion/vol_upload_4nrmrhzy" returned: 0 in 0.567s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:31 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] Image conversion details: src /opt/stack/data/cinder/conversion/4051cc61-cbd6-4096-9770-8184096713cf.temp_image.8a08361d-1018-431b-aba1-c59032e87f73a5_ivwxa.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_4nrmrhzy {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:40:31 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 06 18:40:31 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ff88bb-a476-4f45-9d16-8e46e0e4c9a4]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:40:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4nrmrhzy {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:32 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4nrmrhzy Nov 06 18:40:32 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:32 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4nrmrhzy" returned: 0 in 0.822s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:34 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:40:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Flow 'volume_create_manager' (a4146d77-a589-4e5c-9a2b-8baa029d624b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:40:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae02b1d-efd6-403c-bd9c-3b618d798807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae02b1d-efd6-403c-bd9c-3b618d798807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1337340733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842d3f09-6475-4c19-8f5f-8f60d5076500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f001f7a424499ba4f620e8a7701487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:40:35Z,use_quota=True,user_id='964faefa0d0543ae9f3e6acb88b861fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0319fb0a-ead3-4e1c-b370-7959ad545c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0319fb0a-ead3-4e1c-b370-7959ad545c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b617a6d9-8107-4514-ac9c-ea23198a2479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b617a6d9-8107-4514-ac9c-ea23198a2479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '842d3f09-6475-4c19-8f5f-8f60d5076500', 'volume_name': 'volume-842d3f09-6475-4c19-8f5f-8f60d5076500', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ee344a-66ac-428a-817f-00ab3acf7862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ee344a-66ac-428a-817f-00ab3acf7862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a223be-f6a0-4fbd-935b-49c029fbf91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:34 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Volume 842d3f09-6475-4c19-8f5f-8f60d5076500: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-842d3f09-6475-4c19-8f5f-8f60d5076500', 'volume_size': 1} Nov 06 18:40:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 20.885s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] Uploaded volume to glance image-id: 8a08361d-1018-431b-aba1-c59032e87f73. {{(pid=86794) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.392s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1337340733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842d3f09-6475-4c19-8f5f-8f60d5076500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f001f7a424499ba4f620e8a7701487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:40:35Z,use_quota=True,user_id='964faefa0d0543ae9f3e6acb88b861fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Creating volume 842d3f09-6475-4c19-8f5f-8f60d5076500 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:40:36 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-842d3f09-6475-4c19-8f5f-8f60d5076500 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:36 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-842d3f09-6475-4c19-8f5f-8f60d5076500 1073741824 Nov 06 18:40:36 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:36 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-f40367d4-debf-4af0-a86f-6ec8d7b87230 tempest-VolumesActionsTest-550889764 None] Copy volume to image completed successfully. Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Flow 'volume_create_manager' (f3c8a2b0-664a-4db2-9fa6-2a7ab9b023a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8e8a78-5fda-42bd-b9e0-bd361896a858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8e8a78-5fda-42bd-b9e0-bd361896a858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-80781770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9acf28cb-1619-4956-ad27-484f18bdf66b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b14ce1cfe6344ab918995f59d968557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:40:36Z,use_quota=True,user_id='c1b9419f46014a368af4af5044a074f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a2978a-7ad0-4a27-b6be-a38f28645807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a2978a-7ad0-4a27-b6be-a38f28645807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77bce98-95eb-4bda-a262-e375fde2d4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77bce98-95eb-4bda-a262-e375fde2d4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9acf28cb-1619-4956-ad27-484f18bdf66b', 'volume_name': 'volume-9acf28cb-1619-4956-ad27-484f18bdf66b', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (100d8ad4-7c83-4292-aead-2dd5d4f2a2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (100d8ad4-7c83-4292-aead-2dd5d4f2a2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49aa7375-8d23-4c33-954f-ccd0efc980cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:36 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Volume 9acf28cb-1619-4956-ad27-484f18bdf66b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9acf28cb-1619-4956-ad27-484f18bdf66b', 'volume_size': 1} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:36 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-842d3f09-6475-4c19-8f5f-8f60d5076500 1073741824" returned: 0 in 0.559s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-842d3f09-6475-4c19-8f5f-8f60d5076500 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:36 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-842d3f09-6475-4c19-8f5f-8f60d5076500 Nov 06 18:40:36 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:36 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-842d3f09-6475-4c19-8f5f-8f60d5076500" returned: 0 in 0.276s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:40:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.688s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-80781770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9acf28cb-1619-4956-ad27-484f18bdf66b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b14ce1cfe6344ab918995f59d968557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:40:36Z,use_quota=True,user_id='c1b9419f46014a368af4af5044a074f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:40:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Creating volume 9acf28cb-1619-4956-ad27-484f18bdf66b {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:40:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:40:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:40:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:40:37 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:40:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9acf28cb-1619-4956-ad27-484f18bdf66b 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a223be-f6a0-4fbd-935b-49c029fbf91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-842d3f09-6475-4c19-8f5f-8f60d5076500', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e06a12-f95e-439f-97e7-d07ea6b88532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:37 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9acf28cb-1619-4956-ad27-484f18bdf66b 1073741824 Nov 06 18:40:37 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:37 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Volume volume-842d3f09-6475-4c19-8f5f-8f60d5076500 (842d3f09-6475-4c19-8f5f-8f60d5076500): created successfully Nov 06 18:40:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e06a12-f95e-439f-97e7-d07ea6b88532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Flow 'volume_create_manager' (a4146d77-a589-4e5c-9a2b-8baa029d624b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:40:37 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-2f3994f0-056b-488d-933f-695d46593f51 tempest-AttachVolumeNegativeTest-672322174 None] Created volume successfully. Nov 06 18:40:37 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9acf28cb-1619-4956-ad27-484f18bdf66b 1073741824" returned: 0 in 0.582s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9acf28cb-1619-4956-ad27-484f18bdf66b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:37 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9acf28cb-1619-4956-ad27-484f18bdf66b Nov 06 18:40:37 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:38 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9acf28cb-1619-4956-ad27-484f18bdf66b" returned: 0 in 0.425s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:40:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ae131846-d0cb-42f7-8b90-ea136d524a38 tempest-VolumesActionsTest-550889764 None] Acquiring lock "cinder-4051cc61-cbd6-4096-9770-8184096713cf-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:40:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49aa7375-8d23-4c33-954f-ccd0efc980cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9acf28cb-1619-4956-ad27-484f18bdf66b', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93063e67-38af-4a4f-9333-25859c672bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ae131846-d0cb-42f7-8b90-ea136d524a38 tempest-VolumesActionsTest-550889764 None] Lock "cinder-4051cc61-cbd6-4096-9770-8184096713cf-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:40:38 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Volume volume-9acf28cb-1619-4956-ad27-484f18bdf66b (9acf28cb-1619-4956-ad27-484f18bdf66b): created successfully Nov 06 18:40:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93063e67-38af-4a4f-9333-25859c672bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Flow 'volume_create_manager' (f3c8a2b0-664a-4db2-9fa6-2a7ab9b023a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:40:38 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-0559a334-de0b-418c-a8c4-fa75f58c0776 tempest-VolumesActionsTest-418687457 None] Created volume successfully. Nov 06 18:40:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ae131846-d0cb-42f7-8b90-ea136d524a38 tempest-VolumesActionsTest-550889764 None] Acquiring lock "cinder-quobyte-4051cc61-cbd6-4096-9770-8184096713cf" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:40:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ae131846-d0cb-42f7-8b90-ea136d524a38 tempest-VolumesActionsTest-550889764 None] Lock "cinder-quobyte-4051cc61-cbd6-4096-9770-8184096713cf" acquired by "delete_volume" :: waited 0.053s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:40:38 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7678811d-c76c-46d1-aa1e-4df485e33717]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:40:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae131846-d0cb-42f7-8b90-ea136d524a38 tempest-VolumesActionsTest-550889764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fd3a5c69-4d1d-4704-8295-396c9c2e305b tempest-VolumesActionsTest-418687457 None] Acquiring lock "cinder-9acf28cb-1619-4956-ad27-484f18bdf66b" by "attach_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:40:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fd3a5c69-4d1d-4704-8295-396c9c2e305b tempest-VolumesActionsTest-418687457 None] Lock "cinder-9acf28cb-1619-4956-ad27-484f18bdf66b" acquired by "attach_volume" :: waited 0.046s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:40:38 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-fd3a5c69-4d1d-4704-8295-396c9c2e305b tempest-VolumesActionsTest-418687457 None] Attaching volume 9acf28cb-1619-4956-ad27-484f18bdf66b to instance cc9ed317-9d23-4d8f-a88d-7d5d13c82fc3 at mountpoint /dev/vdb on host None. Nov 06 18:40:38 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf Nov 06 18:40:38 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:38 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-fd3a5c69-4d1d-4704-8295-396c9c2e305b tempest-VolumesActionsTest-418687457 None] Attach volume completed successfully. Nov 06 18:40:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fd3a5c69-4d1d-4704-8295-396c9c2e305b tempest-VolumesActionsTest-418687457 None] Lock "cinder-9acf28cb-1619-4956-ad27-484f18bdf66b" released by "attach_volume" :: held 0.255s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:40:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-d869bce5-135c-43df-9752-aec48d3fd4d9 req-55a8a4d1-0bdf-4c83-95da-64b70e772fcb tempest-AttachVolumeNegativeTest-672322174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-d869bce5-135c-43df-9752-aec48d3fd4d9 req-55a8a4d1-0bdf-4c83-95da-64b70e772fcb tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-d869bce5-135c-43df-9752-aec48d3fd4d9 req-55a8a4d1-0bdf-4c83-95da-64b70e772fcb tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:39 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae131846-d0cb-42f7-8b90-ea136d524a38 tempest-VolumesActionsTest-550889764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf" returned: 0 in 0.853s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae131846-d0cb-42f7-8b90-ea136d524a38 tempest-VolumesActionsTest-550889764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-d869bce5-135c-43df-9752-aec48d3fd4d9 req-55a8a4d1-0bdf-4c83-95da-64b70e772fcb tempest-AttachVolumeNegativeTest-672322174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-842d3f09-6475-4c19-8f5f-8f60d5076500', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'efea02e1-0c9e-4398-8418-e0ea601a6b94', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:40:39 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf Nov 06 18:40:39 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:39 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-d869bce5-135c-43df-9752-aec48d3fd4d9 req-55a8a4d1-0bdf-4c83-95da-64b70e772fcb tempest-AttachVolumeNegativeTest-672322174 None] attachment_update completed successfully. Nov 06 18:40:39 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae131846-d0cb-42f7-8b90-ea136d524a38 tempest-VolumesActionsTest-550889764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4051cc61-cbd6-4096-9770-8184096713cf" returned: 0 in 0.401s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ae131846-d0cb-42f7-8b90-ea136d524a38 tempest-VolumesActionsTest-550889764 None] Lock "cinder-quobyte-4051cc61-cbd6-4096-9770-8184096713cf" released by "delete_volume" :: held 1.355s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:40:39 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-ae131846-d0cb-42f7-8b90-ea136d524a38 tempest-VolumesActionsTest-550889764 None] Created reservations ['91e675a2-3df7-4ee6-b819-933c786d65a6', 'ade65c1d-87cb-445d-8868-735459a27c3f', '628c9040-21af-47e9-9c3c-e7d1b8af8857', '0adef774-1785-458c-94c0-c4bbf66e31e4'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:40:39 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-da4ed08a-ab6e-4145-99c7-3c55e73a5902 tempest-VolumesActionsTest-1249116603 None] Terminate volume connection completed successfully. Nov 06 18:40:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ae131846-d0cb-42f7-8b90-ea136d524a38 tempest-VolumesActionsTest-550889764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ae131846-d0cb-42f7-8b90-ea136d524a38 tempest-VolumesActionsTest-550889764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ae131846-d0cb-42f7-8b90-ea136d524a38 tempest-VolumesActionsTest-550889764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:40:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ae131846-d0cb-42f7-8b90-ea136d524a38 tempest-VolumesActionsTest-550889764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:40:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ae131846-d0cb-42f7-8b90-ea136d524a38 tempest-VolumesActionsTest-550889764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae131846-d0cb-42f7-8b90-ea136d524a38 tempest-VolumesActionsTest-550889764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:39 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:40:39 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-da4ed08a-ab6e-4145-99c7-3c55e73a5902 tempest-VolumesActionsTest-1249116603 None] Acquiring lock "cinder-9acf28cb-1619-4956-ad27-484f18bdf66b-detach_volume" by "detach_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:40:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-da4ed08a-ab6e-4145-99c7-3c55e73a5902 tempest-VolumesActionsTest-1249116603 None] Lock "cinder-9acf28cb-1619-4956-ad27-484f18bdf66b-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:40:40 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-da4ed08a-ab6e-4145-99c7-3c55e73a5902 tempest-VolumesActionsTest-1249116603 None] Detaching volume 9acf28cb-1619-4956-ad27-484f18bdf66b from instance cc9ed317-9d23-4d8f-a88d-7d5d13c82fc3. Nov 06 18:40:40 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-da4ed08a-ab6e-4145-99c7-3c55e73a5902 tempest-VolumesActionsTest-1249116603 None] Detach volume completed successfully. Nov 06 18:40:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-da4ed08a-ab6e-4145-99c7-3c55e73a5902 tempest-VolumesActionsTest-1249116603 None] Lock "cinder-9acf28cb-1619-4956-ad27-484f18bdf66b-detach_volume" released by "detach_volume" :: held 0.087s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:40:40 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae131846-d0cb-42f7-8b90-ea136d524a38 tempest-VolumesActionsTest-550889764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.353s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:40 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-ae131846-d0cb-42f7-8b90-ea136d524a38 tempest-VolumesActionsTest-550889764 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:40:40 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-ae131846-d0cb-42f7-8b90-ea136d524a38 tempest-VolumesActionsTest-550889764 None] Deleted volume successfully. Nov 06 18:40:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3563f8c6-55c2-40b3-9e3e-04a7f62ad01b tempest-VolumesActionsTest-418687457 None] Acquiring lock "cinder-9acf28cb-1619-4956-ad27-484f18bdf66b-detach_volume" by "detach_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:40:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ae131846-d0cb-42f7-8b90-ea136d524a38 tempest-VolumesActionsTest-550889764 None] Lock "cinder-4051cc61-cbd6-4096-9770-8184096713cf-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:40:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3563f8c6-55c2-40b3-9e3e-04a7f62ad01b tempest-VolumesActionsTest-418687457 None] Lock "cinder-9acf28cb-1619-4956-ad27-484f18bdf66b-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:40:40 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-3563f8c6-55c2-40b3-9e3e-04a7f62ad01b tempest-VolumesActionsTest-418687457 None] Volume detach called, but volume not attached. Nov 06 18:40:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3563f8c6-55c2-40b3-9e3e-04a7f62ad01b tempest-VolumesActionsTest-418687457 None] Lock "cinder-9acf28cb-1619-4956-ad27-484f18bdf66b-detach_volume" released by "detach_volume" :: held 0.029s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:40:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c715629a-2803-4ac7-bfae-b30e3aa49e85 tempest-VolumesActionsTest-418687457 None] Acquiring lock "cinder-9acf28cb-1619-4956-ad27-484f18bdf66b-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:40:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c715629a-2803-4ac7-bfae-b30e3aa49e85 tempest-VolumesActionsTest-418687457 None] Lock "cinder-9acf28cb-1619-4956-ad27-484f18bdf66b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:40:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c715629a-2803-4ac7-bfae-b30e3aa49e85 tempest-VolumesActionsTest-418687457 None] Acquiring lock "cinder-quobyte-9acf28cb-1619-4956-ad27-484f18bdf66b" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:40:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c715629a-2803-4ac7-bfae-b30e3aa49e85 tempest-VolumesActionsTest-418687457 None] Lock "cinder-quobyte-9acf28cb-1619-4956-ad27-484f18bdf66b" acquired by "delete_volume" :: waited 0.018s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:40:40 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72e681f-7846-4b1f-b9f0-ec654fae3c71]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:40:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c715629a-2803-4ac7-bfae-b30e3aa49e85 tempest-VolumesActionsTest-418687457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9acf28cb-1619-4956-ad27-484f18bdf66b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:40 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9acf28cb-1619-4956-ad27-484f18bdf66b Nov 06 18:40:40 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:41 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c715629a-2803-4ac7-bfae-b30e3aa49e85 tempest-VolumesActionsTest-418687457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9acf28cb-1619-4956-ad27-484f18bdf66b" returned: 0 in 0.500s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c715629a-2803-4ac7-bfae-b30e3aa49e85 tempest-VolumesActionsTest-418687457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9acf28cb-1619-4956-ad27-484f18bdf66b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:41 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9acf28cb-1619-4956-ad27-484f18bdf66b Nov 06 18:40:41 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:41 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c715629a-2803-4ac7-bfae-b30e3aa49e85 tempest-VolumesActionsTest-418687457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9acf28cb-1619-4956-ad27-484f18bdf66b" returned: 0 in 0.505s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c715629a-2803-4ac7-bfae-b30e3aa49e85 tempest-VolumesActionsTest-418687457 None] Lock "cinder-quobyte-9acf28cb-1619-4956-ad27-484f18bdf66b" released by "delete_volume" :: held 1.062s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:40:41 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-c715629a-2803-4ac7-bfae-b30e3aa49e85 tempest-VolumesActionsTest-418687457 None] Created reservations ['81dfbbc8-0f1d-4a07-970e-17f0ec5b5d14', '9d961c67-0b9e-4448-a95e-bce3b844f2e2', '4b26a813-520c-4d73-af9a-fd8ee300529e', 'a16c437f-85b5-4c3d-b2e4-32a8d121bc97'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:40:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c715629a-2803-4ac7-bfae-b30e3aa49e85 tempest-VolumesActionsTest-418687457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c715629a-2803-4ac7-bfae-b30e3aa49e85 tempest-VolumesActionsTest-418687457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c715629a-2803-4ac7-bfae-b30e3aa49e85 tempest-VolumesActionsTest-418687457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:40:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c715629a-2803-4ac7-bfae-b30e3aa49e85 tempest-VolumesActionsTest-418687457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:40:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c715629a-2803-4ac7-bfae-b30e3aa49e85 tempest-VolumesActionsTest-418687457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c715629a-2803-4ac7-bfae-b30e3aa49e85 tempest-VolumesActionsTest-418687457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:41 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:40:41 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:42 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-1fa038c5-1d8f-4d92-bfa1-e67c9c413cbc req-6485d10a-b5f6-4fa9-9571-e8f9ec9e018e tempest-AttachVolumeNegativeTest-672322174 None] Terminate volume connection completed successfully. Nov 06 18:40:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-1fa038c5-1d8f-4d92-bfa1-e67c9c413cbc req-6485d10a-b5f6-4fa9-9571-e8f9ec9e018e tempest-AttachVolumeNegativeTest-672322174 None] Deleting attachment efea02e1-0c9e-4398-8418-e0ea601a6b94. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:40:42 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c715629a-2803-4ac7-bfae-b30e3aa49e85 tempest-VolumesActionsTest-418687457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.535s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:42 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-c715629a-2803-4ac7-bfae-b30e3aa49e85 tempest-VolumesActionsTest-418687457 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:40:42 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c715629a-2803-4ac7-bfae-b30e3aa49e85 tempest-VolumesActionsTest-418687457 None] Deleted volume successfully. Nov 06 18:40:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c715629a-2803-4ac7-bfae-b30e3aa49e85 tempest-VolumesActionsTest-418687457 None] Lock "cinder-9acf28cb-1619-4956-ad27-484f18bdf66b-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Flow 'volume_create_manager' (70d88286-84c7-4598-9f91-85a720b65f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130fd2fe-5914-4666-b6db-5cca678c4776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130fd2fe-5914-4666-b6db-5cca678c4776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1981300702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4524d7-62ff-4796-a019-caf165a0eee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b14ce1cfe6344ab918995f59d968557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:40:48Z,use_quota=True,user_id='c1b9419f46014a368af4af5044a074f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36be040-81ea-414a-a037-b5de0b524422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36be040-81ea-414a-a037-b5de0b524422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f58baa5-36f4-4776-9b15-ba5ad0e0ebc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f58baa5-36f4-4776-9b15-ba5ad0e0ebc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f4524d7-62ff-4796-a019-caf165a0eee4', 'volume_name': 'volume-7f4524d7-62ff-4796-a019-caf165a0eee4', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (015956ab-4974-485b-a2ce-aabc9290f938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (015956ab-4974-485b-a2ce-aabc9290f938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c108720-b980-46e5-b62b-593c7427ea8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:47 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Volume 7f4524d7-62ff-4796-a019-caf165a0eee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f4524d7-62ff-4796-a019-caf165a0eee4', 'volume_size': 1} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1981300702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4524d7-62ff-4796-a019-caf165a0eee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b14ce1cfe6344ab918995f59d968557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:40:48Z,use_quota=True,user_id='c1b9419f46014a368af4af5044a074f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Creating volume 7f4524d7-62ff-4796-a019-caf165a0eee4 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:40:47 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:40:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7f4524d7-62ff-4796-a019-caf165a0eee4 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:47 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7f4524d7-62ff-4796-a019-caf165a0eee4 1073741824 Nov 06 18:40:47 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:48 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7f4524d7-62ff-4796-a019-caf165a0eee4 1073741824" returned: 0 in 0.654s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7f4524d7-62ff-4796-a019-caf165a0eee4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:48 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7f4524d7-62ff-4796-a019-caf165a0eee4 Nov 06 18:40:48 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:48 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7f4524d7-62ff-4796-a019-caf165a0eee4" returned: 0 in 0.308s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:40:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c108720-b980-46e5-b62b-593c7427ea8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f4524d7-62ff-4796-a019-caf165a0eee4', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa8e1d1-2527-4df4-850a-e1e3951606b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:48 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Volume volume-7f4524d7-62ff-4796-a019-caf165a0eee4 (7f4524d7-62ff-4796-a019-caf165a0eee4): created successfully Nov 06 18:40:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa8e1d1-2527-4df4-850a-e1e3951606b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Flow 'volume_create_manager' (70d88286-84c7-4598-9f91-85a720b65f9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:40:48 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-1bac8715-bf08-405e-af4c-a5a2e93c66cc tempest-VolumesActionsTest-418687457 None] Created volume successfully. Nov 06 18:40:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f5b1a0ea-aa5e-4c70-ba33-18e75bd30b13 tempest-VolumesActionsTest-1249116603 None] Acquiring lock "cinder-7f4524d7-62ff-4796-a019-caf165a0eee4-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:40:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f5b1a0ea-aa5e-4c70-ba33-18e75bd30b13 tempest-VolumesActionsTest-1249116603 None] Lock "cinder-7f4524d7-62ff-4796-a019-caf165a0eee4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:40:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f5b1a0ea-aa5e-4c70-ba33-18e75bd30b13 tempest-VolumesActionsTest-1249116603 None] Acquiring lock "cinder-quobyte-7f4524d7-62ff-4796-a019-caf165a0eee4" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:40:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f5b1a0ea-aa5e-4c70-ba33-18e75bd30b13 tempest-VolumesActionsTest-1249116603 None] Lock "cinder-quobyte-7f4524d7-62ff-4796-a019-caf165a0eee4" acquired by "delete_volume" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:40:49 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a3545a-48b2-45e6-97f7-d04d8706de70]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:40:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f5b1a0ea-aa5e-4c70-ba33-18e75bd30b13 tempest-VolumesActionsTest-1249116603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7f4524d7-62ff-4796-a019-caf165a0eee4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:50 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7f4524d7-62ff-4796-a019-caf165a0eee4 Nov 06 18:40:50 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:50 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f5b1a0ea-aa5e-4c70-ba33-18e75bd30b13 tempest-VolumesActionsTest-1249116603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7f4524d7-62ff-4796-a019-caf165a0eee4" returned: 0 in 0.542s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f5b1a0ea-aa5e-4c70-ba33-18e75bd30b13 tempest-VolumesActionsTest-1249116603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7f4524d7-62ff-4796-a019-caf165a0eee4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:50 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7f4524d7-62ff-4796-a019-caf165a0eee4 Nov 06 18:40:50 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Flow 'volume_create_manager' (b9a2ccf9-45e7-482f-967f-3281dc5f614d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d7958b-df31-4641-9306-05f07b784082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d7958b-df31-4641-9306-05f07b784082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1363525877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bfdc8f6-3d04-40af-b579-ffadacd169a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b9d2665f1446f6a7d9906832a215c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:40:51Z,use_quota=True,user_id='db19e4f0ef3446d2ba9c8c9154187541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dbe4358-a158-4476-ac27-120b97bf1538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dbe4358-a158-4476-ac27-120b97bf1538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757bfa2d-b769-49dd-937c-32d2837a8346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757bfa2d-b769-49dd-937c-32d2837a8346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bfdc8f6-3d04-40af-b579-ffadacd169a2', 'volume_name': 'volume-5bfdc8f6-3d04-40af-b579-ffadacd169a2', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d7a42b3-1dfc-4e09-886f-161332dd6b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d7a42b3-1dfc-4e09-886f-161332dd6b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a04531f-0413-484c-90ad-ff0d64c8a30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:50 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Volume 5bfdc8f6-3d04-40af-b579-ffadacd169a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bfdc8f6-3d04-40af-b579-ffadacd169a2', 'volume_size': 1} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1363525877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bfdc8f6-3d04-40af-b579-ffadacd169a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b9d2665f1446f6a7d9906832a215c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:40:51Z,use_quota=True,user_id='db19e4f0ef3446d2ba9c8c9154187541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Creating volume 5bfdc8f6-3d04-40af-b579-ffadacd169a2 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:40:50 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5bfdc8f6-3d04-40af-b579-ffadacd169a2 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:50 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5bfdc8f6-3d04-40af-b579-ffadacd169a2 1073741824 Nov 06 18:40:50 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:50 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f5b1a0ea-aa5e-4c70-ba33-18e75bd30b13 tempest-VolumesActionsTest-1249116603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7f4524d7-62ff-4796-a019-caf165a0eee4" returned: 0 in 0.329s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f5b1a0ea-aa5e-4c70-ba33-18e75bd30b13 tempest-VolumesActionsTest-1249116603 None] Lock "cinder-quobyte-7f4524d7-62ff-4796-a019-caf165a0eee4" released by "delete_volume" :: held 0.945s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:40:50 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-f5b1a0ea-aa5e-4c70-ba33-18e75bd30b13 tempest-VolumesActionsTest-1249116603 None] Created reservations ['03c40423-68f8-4883-bba3-6d00961c61a2', 'cfe22eb6-a181-4818-97fb-8b9a6d0dc42e', '3b031eb0-7d13-46b4-9c62-4054fa54b33b', '66a35d1c-4f4b-4b2d-a617-da7ade3d4ef2'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f5b1a0ea-aa5e-4c70-ba33-18e75bd30b13 tempest-VolumesActionsTest-1249116603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f5b1a0ea-aa5e-4c70-ba33-18e75bd30b13 tempest-VolumesActionsTest-1249116603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f5b1a0ea-aa5e-4c70-ba33-18e75bd30b13 tempest-VolumesActionsTest-1249116603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f5b1a0ea-aa5e-4c70-ba33-18e75bd30b13 tempest-VolumesActionsTest-1249116603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f5b1a0ea-aa5e-4c70-ba33-18e75bd30b13 tempest-VolumesActionsTest-1249116603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f5b1a0ea-aa5e-4c70-ba33-18e75bd30b13 tempest-VolumesActionsTest-1249116603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:51 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:40:51 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:51 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5bfdc8f6-3d04-40af-b579-ffadacd169a2 1073741824" returned: 0 in 0.624s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5bfdc8f6-3d04-40af-b579-ffadacd169a2 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:51 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f5b1a0ea-aa5e-4c70-ba33-18e75bd30b13 tempest-VolumesActionsTest-1249116603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.413s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-f5b1a0ea-aa5e-4c70-ba33-18e75bd30b13 tempest-VolumesActionsTest-1249116603 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:40:51 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5bfdc8f6-3d04-40af-b579-ffadacd169a2 Nov 06 18:40:51 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:51 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-f5b1a0ea-aa5e-4c70-ba33-18e75bd30b13 tempest-VolumesActionsTest-1249116603 None] Deleted volume successfully. Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f5b1a0ea-aa5e-4c70-ba33-18e75bd30b13 tempest-VolumesActionsTest-1249116603 None] Lock "cinder-7f4524d7-62ff-4796-a019-caf165a0eee4-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:40:51 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5bfdc8f6-3d04-40af-b579-ffadacd169a2" returned: 0 in 0.383s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a04531f-0413-484c-90ad-ff0d64c8a30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bfdc8f6-3d04-40af-b579-ffadacd169a2', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a190687-537b-4f62-bd00-8c6322e544c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:51 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Volume volume-5bfdc8f6-3d04-40af-b579-ffadacd169a2 (5bfdc8f6-3d04-40af-b579-ffadacd169a2): created successfully Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a190687-537b-4f62-bd00-8c6322e544c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Flow 'volume_create_manager' (b9a2ccf9-45e7-482f-967f-3281dc5f614d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:40:51 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-f2255b57-4d10-4a51-9ec8-ef422501bbe3 tempest-AttachVolumeTestJSON-901828419 None] Created volume successfully. Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Flow 'volume_create_manager' (ec3abe86-401f-4de1-b354-374de4183837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ccfbdeb-5b03-4c5a-a6c4-50fb028f4e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ccfbdeb-5b03-4c5a-a6c4-50fb028f4e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2081274229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=971189e1-f2eb-4e17-8ce3-4cf54845a72c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b99ae4d2227d4253972c42fe378e6a84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:40:52Z,use_quota=True,user_id='c5a70fa39fc8495abf97e1bf501656e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26d4acf-c7a9-40d3-843c-0a4785e141c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26d4acf-c7a9-40d3-843c-0a4785e141c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad455462-f087-4436-88e5-df68c1145c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.image.glance [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Creating Keystone auth plugin from conf {{(pid=86794) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Flow 'volume_create_manager' (3ef0040d-3ce2-4164-8684-8153604c8468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ce0cee-c823-4e59-8347-aad5d4fec3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ce0cee-c823-4e59-8347-aad5d4fec3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-724640932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01428ce9-2113-40be-aab8-b047af132511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b14ce1cfe6344ab918995f59d968557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:40:52Z,use_quota=True,user_id='c1b9419f46014a368af4af5044a074f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0224a0c0-d0c4-449b-865a-fddb905c6b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0224a0c0-d0c4-449b-865a-fddb905c6b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35128cf5-c6f9-4e59-9c9e-799db8056be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35128cf5-c6f9-4e59-9c9e-799db8056be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01428ce9-2113-40be-aab8-b047af132511', 'volume_name': 'volume-01428ce9-2113-40be-aab8-b047af132511', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e2659d-8c37-479f-858d-4fc937881796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e2659d-8c37-479f-858d-4fc937881796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6019452b-eac6-4b31-923a-ec8fc9ed9db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:52 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Volume 01428ce9-2113-40be-aab8-b047af132511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01428ce9-2113-40be-aab8-b047af132511', 'volume_size': 1} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-724640932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01428ce9-2113-40be-aab8-b047af132511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b14ce1cfe6344ab918995f59d968557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:40:52Z,use_quota=True,user_id='c1b9419f46014a368af4af5044a074f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Creating volume 01428ce9-2113-40be-aab8-b047af132511 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:40:52 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-01428ce9-2113-40be-aab8-b047af132511 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:52 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-01428ce9-2113-40be-aab8-b047af132511 1073741824 Nov 06 18:40:52 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad455462-f087-4436-88e5-df68c1145c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '971189e1-f2eb-4e17-8ce3-4cf54845a72c', 'volume_name': 'volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c', 'volume_size': 1, 'image_id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d57c6da8e464b1a80cefabe6e3cfecd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'created_at': datetime.datetime(2026, 11, 6, 17, 27, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 27, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459ff351-7767-407f-b69d-8ec16d5b0c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459ff351-7767-407f-b69d-8ec16d5b0c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a71bc35-9ba9-49dd-8cb1-9840d7e9c55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:52 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Volume 971189e1-f2eb-4e17-8ce3-4cf54845a72c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c', 'volume_size': 1, 'image_id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d57c6da8e464b1a80cefabe6e3cfecd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'created_at': datetime.datetime(2026, 11, 6, 17, 27, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 27, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Trying to clone 971189e1-f2eb-4e17-8ce3-4cf54845a72c from image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}]). {{(pid=86794) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ulqhx406devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 18:40:52 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Image download 20.69 MB at 20.69 MB/s Nov 06 18:40:52 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-01428ce9-2113-40be-aab8-b047af132511 1073741824" returned: 0 in 0.664s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-01428ce9-2113-40be-aab8-b047af132511 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:52 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-01428ce9-2113-40be-aab8-b047af132511 Nov 06 18:40:52 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[973847af-4967-49ce-ba94-40309904c72a]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:40:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ulqhx406devstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:53 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ulqhx406devstack@QuobyteHD Nov 06 18:40:53 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:53 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-01428ce9-2113-40be-aab8-b047af132511" returned: 0 in 0.488s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:40:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6019452b-eac6-4b31-923a-ec8fc9ed9db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01428ce9-2113-40be-aab8-b047af132511', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a04b00-864d-4095-b0ce-77c24a6ec56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:53 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Volume volume-01428ce9-2113-40be-aab8-b047af132511 (01428ce9-2113-40be-aab8-b047af132511): created successfully Nov 06 18:40:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a04b00-864d-4095-b0ce-77c24a6ec56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Flow 'volume_create_manager' (3ef0040d-3ce2-4164-8684-8153604c8468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:40:53 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ulqhx406devstack@QuobyteHD" returned: 0 in 0.522s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:53 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Temporary image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 is fetched for user c5a70fa39fc8495abf97e1bf501656e3. {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 18:40:53 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-6d7cf5c1-afc9-4d94-982a-8a63ded9424b tempest-VolumesActionsTest-418687457 None] Created volume successfully. Nov 06 18:40:53 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[3381a8a5-6008-4e94-8842-2af9f1691ae4]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:40:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ulqhx406devstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:53 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ulqhx406devstack@QuobyteHD Nov 06 18:40:53 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:54 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ulqhx406devstack@QuobyteHD" returned: 0 in 0.471s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2081274229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=971189e1-f2eb-4e17-8ce3-4cf54845a72c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b99ae4d2227d4253972c42fe378e6a84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:40:52Z,use_quota=True,user_id='c5a70fa39fc8495abf97e1bf501656e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Creating volume 971189e1-f2eb-4e17-8ce3-4cf54845a72c {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:40:54 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:54 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c 1073741824 Nov 06 18:40:54 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-bf50fa6e-e0fe-45f6-9dc8-c00e5bd50f3b req-e0e88fae-2e64-48ea-a4cd-c7a978e31702 tempest-AttachVolumeTestJSON-901828419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9b635e22-9f49-4c8c-a881-8a2fb47028cf tempest-VolumesActionsTest-1249116603 None] Acquiring lock "cinder-01428ce9-2113-40be-aab8-b047af132511-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9b635e22-9f49-4c8c-a881-8a2fb47028cf tempest-VolumesActionsTest-1249116603 None] Lock "cinder-01428ce9-2113-40be-aab8-b047af132511-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9b635e22-9f49-4c8c-a881-8a2fb47028cf tempest-VolumesActionsTest-1249116603 None] Acquiring lock "cinder-quobyte-01428ce9-2113-40be-aab8-b047af132511" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9b635e22-9f49-4c8c-a881-8a2fb47028cf tempest-VolumesActionsTest-1249116603 None] Lock "cinder-quobyte-01428ce9-2113-40be-aab8-b047af132511" acquired by "delete_volume" :: waited 0.027s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20b13df-fd4e-499c-97ad-556d60a6bde5]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9b635e22-9f49-4c8c-a881-8a2fb47028cf tempest-VolumesActionsTest-1249116603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-01428ce9-2113-40be-aab8-b047af132511 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:54 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c 1073741824" returned: 0 in 0.794s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:54 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-01428ce9-2113-40be-aab8-b047af132511 Nov 06 18:40:54 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:55 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c Nov 06 18:40:55 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:55 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c" returned: 0 in 0.390s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:55 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:40:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-bf50fa6e-e0fe-45f6-9dc8-c00e5bd50f3b req-e0e88fae-2e64-48ea-a4cd-c7a978e31702 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.139s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-bf50fa6e-e0fe-45f6-9dc8-c00e5bd50f3b req-e0e88fae-2e64-48ea-a4cd-c7a978e31702 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:55 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Attempting download of 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}])) to volume 971189e1-f2eb-4e17-8ce3-4cf54845a72c. {{(pid=86794) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 18:40:55 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9b635e22-9f49-4c8c-a881-8a2fb47028cf tempest-VolumesActionsTest-1249116603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-01428ce9-2113-40be-aab8-b047af132511" returned: 0 in 0.667s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9b635e22-9f49-4c8c-a881-8a2fb47028cf tempest-VolumesActionsTest-1249116603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-01428ce9-2113-40be-aab8-b047af132511 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-bf50fa6e-e0fe-45f6-9dc8-c00e5bd50f3b req-e0e88fae-2e64-48ea-a4cd-c7a978e31702 tempest-AttachVolumeTestJSON-901828419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-5bfdc8f6-3d04-40af-b579-ffadacd169a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d855145-aff4-45de-aa5b-c963e7d34c00', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:40:55 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-01428ce9-2113-40be-aab8-b047af132511 Nov 06 18:40:55 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:55 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df64bac-d3e4-479f-9f60-9ff91404915e]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:40:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_dmatieom {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:55 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-bf50fa6e-e0fe-45f6-9dc8-c00e5bd50f3b req-e0e88fae-2e64-48ea-a4cd-c7a978e31702 tempest-AttachVolumeTestJSON-901828419 None] attachment_update completed successfully. Nov 06 18:40:55 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_dmatieom Nov 06 18:40:55 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:55 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9b635e22-9f49-4c8c-a881-8a2fb47028cf tempest-VolumesActionsTest-1249116603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-01428ce9-2113-40be-aab8-b047af132511" returned: 0 in 0.465s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:55 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9b635e22-9f49-4c8c-a881-8a2fb47028cf tempest-VolumesActionsTest-1249116603 None] Lock "cinder-quobyte-01428ce9-2113-40be-aab8-b047af132511" released by "delete_volume" :: held 1.226s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:40:55 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_dmatieom" returned: 0 in 0.482s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_dmatieom {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:56 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-9b635e22-9f49-4c8c-a881-8a2fb47028cf tempest-VolumesActionsTest-1249116603 None] Created reservations ['e95eb59f-67e6-4cb8-8b98-999a23672af3', '6adb6525-dace-48cb-9379-97207f8c1094', '46707ee1-dddd-4fdf-92c4-a40ebd6d4f85', '897f1e44-916c-4c89-8f8b-c7cfab65939d'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:40:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9b635e22-9f49-4c8c-a881-8a2fb47028cf tempest-VolumesActionsTest-1249116603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9b635e22-9f49-4c8c-a881-8a2fb47028cf tempest-VolumesActionsTest-1249116603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:56 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9b635e22-9f49-4c8c-a881-8a2fb47028cf tempest-VolumesActionsTest-1249116603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:40:56 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9b635e22-9f49-4c8c-a881-8a2fb47028cf tempest-VolumesActionsTest-1249116603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:40:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9b635e22-9f49-4c8c-a881-8a2fb47028cf tempest-VolumesActionsTest-1249116603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9b635e22-9f49-4c8c-a881-8a2fb47028cf tempest-VolumesActionsTest-1249116603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:56 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:40:56 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:56 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_dmatieom Nov 06 18:40:56 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:56 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9b635e22-9f49-4c8c-a881-8a2fb47028cf tempest-VolumesActionsTest-1249116603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.335s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:56 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-9b635e22-9f49-4c8c-a881-8a2fb47028cf tempest-VolumesActionsTest-1249116603 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:40:56 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-9b635e22-9f49-4c8c-a881-8a2fb47028cf tempest-VolumesActionsTest-1249116603 None] Deleted volume successfully. Nov 06 18:40:56 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9b635e22-9f49-4c8c-a881-8a2fb47028cf tempest-VolumesActionsTest-1249116603 None] Lock "cinder-01428ce9-2113-40be-aab8-b047af132511-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:40:56 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_dmatieom" returned: 1 in 0.609s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_dmatieom' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:40:56 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d69a96a-2f1d-4f45-97c3-f3b79f74bda5]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:40:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ulqhx406devstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:56 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ulqhx406devstack@QuobyteHD Nov 06 18:40:56 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:56 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ulqhx406devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:56 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 was qcow2, converting to qcow2 {{(pid=86794) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 18:40:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ulqhx406devstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:57 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ulqhx406devstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c Nov 06 18:40:57 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Flow 'volume_create_manager' (cf8faae8-4132-4799-af67-901c15211678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d62ec61-9b7d-4fa5-82db-9e26a24f1e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d62ec61-9b7d-4fa5-82db-9e26a24f1e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-9540849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2cc9cfd-be0b-4c96-aeaf-70672b534713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b14ce1cfe6344ab918995f59d968557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:40:58Z,use_quota=True,user_id='c1b9419f46014a368af4af5044a074f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9307fada-9738-44e6-90c4-97e2414f2703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9307fada-9738-44e6-90c4-97e2414f2703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751c3719-7330-42cb-8b64-942e9e8e8a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751c3719-7330-42cb-8b64-942e9e8e8a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2cc9cfd-be0b-4c96-aeaf-70672b534713', 'volume_name': 'volume-a2cc9cfd-be0b-4c96-aeaf-70672b534713', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c39d67-d3d1-45d5-afc1-bf85edf4843e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c39d67-d3d1-45d5-afc1-bf85edf4843e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfad1f18-24e3-4ab2-854e-631fac040f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:57 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Volume a2cc9cfd-be0b-4c96-aeaf-70672b534713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2cc9cfd-be0b-4c96-aeaf-70672b534713', 'volume_size': 1} Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-9540849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2cc9cfd-be0b-4c96-aeaf-70672b534713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b14ce1cfe6344ab918995f59d968557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:40:58Z,use_quota=True,user_id='c1b9419f46014a368af4af5044a074f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Creating volume a2cc9cfd-be0b-4c96-aeaf-70672b534713 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:40:57 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:40:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a2cc9cfd-be0b-4c96-aeaf-70672b534713 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:57 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a2cc9cfd-be0b-4c96-aeaf-70672b534713 1073741824 Nov 06 18:40:57 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:58 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:40:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Flow 'volume_create_manager' (027acb9e-9c70-4bb5-ae7a-194d870a3522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:40:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10cbd960-f633-427e-a981-6808929450ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10cbd960-f633-427e-a981-6808929450ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1865373365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd87016f-7ea9-47ad-89ad-76da644de219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b9d2665f1446f6a7d9906832a215c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:40:58Z,use_quota=True,user_id='db19e4f0ef3446d2ba9c8c9154187541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370b870c-09a4-4702-8fed-f55e2d9e7072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370b870c-09a4-4702-8fed-f55e2d9e7072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c110f34-1756-4251-8009-51c51d48ec5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c110f34-1756-4251-8009-51c51d48ec5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd87016f-7ea9-47ad-89ad-76da644de219', 'volume_name': 'volume-dd87016f-7ea9-47ad-89ad-76da644de219', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6273d9-deba-4b8b-a06e-9d514dbff7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6273d9-deba-4b8b-a06e-9d514dbff7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107dc852-3564-42d4-8afa-5f7d59bbb13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:58 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Volume dd87016f-7ea9-47ad-89ad-76da644de219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd87016f-7ea9-47ad-89ad-76da644de219', 'volume_size': 1} Nov 06 18:40:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:58 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a2cc9cfd-be0b-4c96-aeaf-70672b534713 1073741824" returned: 0 in 0.950s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a2cc9cfd-be0b-4c96-aeaf-70672b534713 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:58 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a2cc9cfd-be0b-4c96-aeaf-70672b534713 Nov 06 18:40:58 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:59 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Nov 06 18:40:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a2cc9cfd-be0b-4c96-aeaf-70672b534713" returned: 0 in 0.581s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:40:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:40:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.114s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1865373365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd87016f-7ea9-47ad-89ad-76da644de219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b9d2665f1446f6a7d9906832a215c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:40:58Z,use_quota=True,user_id='db19e4f0ef3446d2ba9c8c9154187541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:40:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Creating volume dd87016f-7ea9-47ad-89ad-76da644de219 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:40:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:40:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:40:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:40:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:40:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:40:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:40:59 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:40:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dd87016f-7ea9-47ad-89ad-76da644de219 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:40:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfad1f18-24e3-4ab2-854e-631fac040f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2cc9cfd-be0b-4c96-aeaf-70672b534713', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ca106d-2f78-4844-835b-4135da2e7d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:40:59 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dd87016f-7ea9-47ad-89ad-76da644de219 1073741824 Nov 06 18:40:59 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:40:59 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Volume volume-a2cc9cfd-be0b-4c96-aeaf-70672b534713 (a2cc9cfd-be0b-4c96-aeaf-70672b534713): created successfully Nov 06 18:40:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ca106d-2f78-4844-835b-4135da2e7d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:40:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Flow 'volume_create_manager' (cf8faae8-4132-4799-af67-901c15211678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:40:59 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-00307e8f-a52e-4198-9b64-7c63c08c255d tempest-VolumesActionsTest-418687457 None] Created volume successfully. Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-720826cb-c072-4412-b0f4-5d45cc4ba8a6 tempest-VolumesActionsTest-1249116603 None] Acquiring lock "cinder-a2cc9cfd-be0b-4c96-aeaf-70672b534713-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-720826cb-c072-4412-b0f4-5d45cc4ba8a6 tempest-VolumesActionsTest-1249116603 None] Lock "cinder-a2cc9cfd-be0b-4c96-aeaf-70672b534713-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-720826cb-c072-4412-b0f4-5d45cc4ba8a6 tempest-VolumesActionsTest-1249116603 None] Acquiring lock "cinder-quobyte-a2cc9cfd-be0b-4c96-aeaf-70672b534713" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-720826cb-c072-4412-b0f4-5d45cc4ba8a6 tempest-VolumesActionsTest-1249116603 None] Lock "cinder-quobyte-a2cc9cfd-be0b-4c96-aeaf-70672b534713" acquired by "delete_volume" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:00 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ulqhx406devstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c" returned: 0 in 3.242s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ulqhx406devstack@QuobyteHD, size 112.00 MB, duration 3.25 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:41:00 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Converted 112.00 MB image at 34.51 MB/s Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22ceaa4-155c-4a73-a806-c1545a5f950e]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-720826cb-c072-4412-b0f4-5d45cc4ba8a6 tempest-VolumesActionsTest-1249116603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a2cc9cfd-be0b-4c96-aeaf-70672b534713 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:00 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c 1G Nov 06 18:41:00 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:00 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dd87016f-7ea9-47ad-89ad-76da644de219 1073741824" returned: 0 in 0.906s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dd87016f-7ea9-47ad-89ad-76da644de219 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:00 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dd87016f-7ea9-47ad-89ad-76da644de219 Nov 06 18:41:00 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:00 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a2cc9cfd-be0b-4c96-aeaf-70672b534713 Nov 06 18:41:00 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:00 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c 1G" returned: 0 in 0.652s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Downloaded image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}])) to volume 971189e1-f2eb-4e17-8ce3-4cf54845a72c successfully. {{(pid=86794) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Temporary image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 for user c5a70fa39fc8495abf97e1bf501656e3 is deleted. {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Marking volume 971189e1-f2eb-4e17-8ce3-4cf54845a72c as bootable. {{(pid=86794) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 18:41:00 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dd87016f-7ea9-47ad-89ad-76da644de219" returned: 0 in 0.452s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Copying metadata from image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 to 971189e1-f2eb-4e17-8ce3-4cf54845a72c. {{(pid=86794) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Creating volume glance metadata for volume 971189e1-f2eb-4e17-8ce3-4cf54845a72c backed by image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86794) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107dc852-3564-42d4-8afa-5f7d59bbb13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd87016f-7ea9-47ad-89ad-76da644de219', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74dc7aa4-3d41-4c3a-ae7e-e61c287006ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:00 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Volume volume-dd87016f-7ea9-47ad-89ad-76da644de219 (dd87016f-7ea9-47ad-89ad-76da644de219): created successfully Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74dc7aa4-3d41-4c3a-ae7e-e61c287006ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Flow 'volume_create_manager' (027acb9e-9c70-4bb5-ae7a-194d870a3522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:41:00 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-720826cb-c072-4412-b0f4-5d45cc4ba8a6 tempest-VolumesActionsTest-1249116603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a2cc9cfd-be0b-4c96-aeaf-70672b534713" returned: 0 in 0.707s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-720826cb-c072-4412-b0f4-5d45cc4ba8a6 tempest-VolumesActionsTest-1249116603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a2cc9cfd-be0b-4c96-aeaf-70672b534713 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:00 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-e452ef75-8af1-46be-88c3-519b12e711c9 tempest-AttachVolumeTestJSON-901828419 None] Created volume successfully. Nov 06 18:41:01 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a2cc9cfd-be0b-4c96-aeaf-70672b534713 Nov 06 18:41:01 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a71bc35-9ba9-49dd-8cb1-9840d7e9c55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c', 'volume_size': 1, 'image_id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d57c6da8e464b1a80cefabe6e3cfecd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'created_at': datetime.datetime(2026, 11, 6, 17, 27, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 27, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a20b02-90d8-42c4-a04d-8f4171f03845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:01 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Volume volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c (971189e1-f2eb-4e17-8ce3-4cf54845a72c): created successfully Nov 06 18:41:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a20b02-90d8-42c4-a04d-8f4171f03845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Flow 'volume_create_manager' (ec3abe86-401f-4de1-b354-374de4183837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:41:01 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-af6bdff0-a3fa-4874-b03e-8e0af797ff01 tempest-VolumesExtendTest-1009967172 None] Created volume successfully. Nov 06 18:41:01 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-720826cb-c072-4412-b0f4-5d45cc4ba8a6 tempest-VolumesActionsTest-1249116603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a2cc9cfd-be0b-4c96-aeaf-70672b534713" returned: 0 in 0.278s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:01 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-720826cb-c072-4412-b0f4-5d45cc4ba8a6 tempest-VolumesActionsTest-1249116603 None] Lock "cinder-quobyte-a2cc9cfd-be0b-4c96-aeaf-70672b534713" released by "delete_volume" :: held 1.089s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:01 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-720826cb-c072-4412-b0f4-5d45cc4ba8a6 tempest-VolumesActionsTest-1249116603 None] Created reservations ['d9969902-457a-44ef-8fca-0db98c0f692d', '1544b9db-1b4f-4f3c-8fd2-55f262f6a209', 'fa76642b-0ae9-412d-8d06-9d88b5780aa5', '458264ef-217e-4b16-a3fe-244623f9e8df'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:41:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-720826cb-c072-4412-b0f4-5d45cc4ba8a6 tempest-VolumesActionsTest-1249116603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-720826cb-c072-4412-b0f4-5d45cc4ba8a6 tempest-VolumesActionsTest-1249116603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:01 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-720826cb-c072-4412-b0f4-5d45cc4ba8a6 tempest-VolumesActionsTest-1249116603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:01 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-720826cb-c072-4412-b0f4-5d45cc4ba8a6 tempest-VolumesActionsTest-1249116603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-720826cb-c072-4412-b0f4-5d45cc4ba8a6 tempest-VolumesActionsTest-1249116603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-720826cb-c072-4412-b0f4-5d45cc4ba8a6 tempest-VolumesActionsTest-1249116603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:01 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:41:01 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:01 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-720826cb-c072-4412-b0f4-5d45cc4ba8a6 tempest-VolumesActionsTest-1249116603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.312s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:01 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-720826cb-c072-4412-b0f4-5d45cc4ba8a6 tempest-VolumesActionsTest-1249116603 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:41:01 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-720826cb-c072-4412-b0f4-5d45cc4ba8a6 tempest-VolumesActionsTest-1249116603 None] Deleted volume successfully. Nov 06 18:41:01 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-720826cb-c072-4412-b0f4-5d45cc4ba8a6 tempest-VolumesActionsTest-1249116603 None] Lock "cinder-a2cc9cfd-be0b-4c96-aeaf-70672b534713-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-20e76952-cc24-4aa3-81a4-6461780d39ae tempest-VolumesExtendTest-1009967172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-20e76952-cc24-4aa3-81a4-6461780d39ae tempest-VolumesExtendTest-1009967172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:02 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[4902091a-bf60-4e79-922f-bb53b2b09af4]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-20e76952-cc24-4aa3-81a4-6461780d39ae tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:02 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c Nov 06 18:41:02 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-d5c73db9-9219-4600-9d4a-2cb4a389d80a req-e63dc777-ca75-48b2-8e9c-c20878d47992 tempest-AttachVolumeTestJSON-901828419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:02 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-20e76952-cc24-4aa3-81a4-6461780d39ae tempest-VolumesExtendTest-1009967172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c" returned: 0 in 0.660s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-20e76952-cc24-4aa3-81a4-6461780d39ae tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c 2G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-20e76952-cc24-4aa3-81a4-6461780d39ae tempest-VolumesExtendTest-1009967172 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c 2G" returned: 0 in 0.190s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-20e76952-cc24-4aa3-81a4-6461780d39ae tempest-VolumesExtendTest-1009967172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.921s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-d5c73db9-9219-4600-9d4a-2cb4a389d80a req-e63dc777-ca75-48b2-8e9c-c20878d47992 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.387s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-d5c73db9-9219-4600-9d4a-2cb4a389d80a req-e63dc777-ca75-48b2-8e9c-c20878d47992 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:03 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-20e76952-cc24-4aa3-81a4-6461780d39ae tempest-VolumesExtendTest-1009967172 None] Extend volume completed successfully. Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-d5c73db9-9219-4600-9d4a-2cb4a389d80a req-e63dc777-ca75-48b2-8e9c-c20878d47992 tempest-AttachVolumeTestJSON-901828419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-dd87016f-7ea9-47ad-89ad-76da644de219', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26509009-bd08-40d6-9528-592f6665462d', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Flow 'volume_create_manager' (3f583a3a-0608-4b30-a48b-c301330cda0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b3cf9bc-6cc2-489f-a794-9d873c6eed54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b3cf9bc-6cc2-489f-a794-9d873c6eed54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1698419683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c44d92-02d8-4913-b2ce-4b25bcd34f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b14ce1cfe6344ab918995f59d968557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:41:03Z,use_quota=True,user_id='c1b9419f46014a368af4af5044a074f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ce0b05-d966-4000-8ec4-834a959b2436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ce0b05-d966-4000-8ec4-834a959b2436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631968fc-9e75-4ee3-82b4-690334864734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631968fc-9e75-4ee3-82b4-690334864734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13c44d92-02d8-4913-b2ce-4b25bcd34f2d', 'volume_name': 'volume-13c44d92-02d8-4913-b2ce-4b25bcd34f2d', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c7cc40-6136-4bbb-aed2-463397bb8898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c7cc40-6136-4bbb-aed2-463397bb8898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972ea173-8a78-437f-8c20-23ae51e823fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:03 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Volume 13c44d92-02d8-4913-b2ce-4b25bcd34f2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13c44d92-02d8-4913-b2ce-4b25bcd34f2d', 'volume_size': 1} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1698419683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c44d92-02d8-4913-b2ce-4b25bcd34f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b14ce1cfe6344ab918995f59d968557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:41:03Z,use_quota=True,user_id='c1b9419f46014a368af4af5044a074f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Creating volume 13c44d92-02d8-4913-b2ce-4b25bcd34f2d {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:41:03 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-13c44d92-02d8-4913-b2ce-4b25bcd34f2d 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:03 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-13c44d92-02d8-4913-b2ce-4b25bcd34f2d 1073741824 Nov 06 18:41:03 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:03 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-d5c73db9-9219-4600-9d4a-2cb4a389d80a req-e63dc777-ca75-48b2-8e9c-c20878d47992 tempest-AttachVolumeTestJSON-901828419 None] attachment_update completed successfully. Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-23954b37-ac7f-4a08-a90f-e817a88a5e5c tempest-VolumesExtendTest-1009967172 None] Acquiring lock "cinder-971189e1-f2eb-4e17-8ce3-4cf54845a72c-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-23954b37-ac7f-4a08-a90f-e817a88a5e5c tempest-VolumesExtendTest-1009967172 None] Lock "cinder-971189e1-f2eb-4e17-8ce3-4cf54845a72c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-23954b37-ac7f-4a08-a90f-e817a88a5e5c tempest-VolumesExtendTest-1009967172 None] Acquiring lock "cinder-quobyte-971189e1-f2eb-4e17-8ce3-4cf54845a72c" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-23954b37-ac7f-4a08-a90f-e817a88a5e5c tempest-VolumesExtendTest-1009967172 None] Lock "cinder-quobyte-971189e1-f2eb-4e17-8ce3-4cf54845a72c" acquired by "delete_volume" :: waited 0.043s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1bea47-2b75-4ebd-9bee-50c0cc957a13]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-23954b37-ac7f-4a08-a90f-e817a88a5e5c tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:04 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-13c44d92-02d8-4913-b2ce-4b25bcd34f2d 1073741824" returned: 0 in 0.694s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-13c44d92-02d8-4913-b2ce-4b25bcd34f2d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:04 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-13c44d92-02d8-4913-b2ce-4b25bcd34f2d Nov 06 18:41:04 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:04 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c Nov 06 18:41:04 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:04 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-13c44d92-02d8-4913-b2ce-4b25bcd34f2d" returned: 0 in 0.434s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:41:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972ea173-8a78-437f-8c20-23ae51e823fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13c44d92-02d8-4913-b2ce-4b25bcd34f2d', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b62a7ca4-ee39-4809-8796-4c4a6eb62508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:04 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Volume volume-13c44d92-02d8-4913-b2ce-4b25bcd34f2d (13c44d92-02d8-4913-b2ce-4b25bcd34f2d): created successfully Nov 06 18:41:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b62a7ca4-ee39-4809-8796-4c4a6eb62508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Flow 'volume_create_manager' (3f583a3a-0608-4b30-a48b-c301330cda0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:41:04 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-4fce1e42-7343-4f56-8cdd-ad89408898ba tempest-VolumesActionsTest-418687457 None] Created volume successfully. Nov 06 18:41:04 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-23954b37-ac7f-4a08-a90f-e817a88a5e5c tempest-VolumesExtendTest-1009967172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c" returned: 0 in 0.656s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-23954b37-ac7f-4a08-a90f-e817a88a5e5c tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:04 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c Nov 06 18:41:04 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:04 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-23954b37-ac7f-4a08-a90f-e817a88a5e5c tempest-VolumesExtendTest-1009967172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-971189e1-f2eb-4e17-8ce3-4cf54845a72c" returned: 0 in 0.271s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:04 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-23954b37-ac7f-4a08-a90f-e817a88a5e5c tempest-VolumesExtendTest-1009967172 None] Lock "cinder-quobyte-971189e1-f2eb-4e17-8ce3-4cf54845a72c" released by "delete_volume" :: held 1.008s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:04 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-23954b37-ac7f-4a08-a90f-e817a88a5e5c tempest-VolumesExtendTest-1009967172 None] Created reservations ['cfb21e2b-e516-486a-995c-7a9d386f6e91', 'cfe97335-1afd-4dfb-ae03-087f863bed77', '043afb51-e98c-469e-a95d-46951dc7d568', '0d03b114-edfe-4b64-8d82-dda5b77a95a9'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:41:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-23954b37-ac7f-4a08-a90f-e817a88a5e5c tempest-VolumesExtendTest-1009967172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-23954b37-ac7f-4a08-a90f-e817a88a5e5c tempest-VolumesExtendTest-1009967172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-23954b37-ac7f-4a08-a90f-e817a88a5e5c tempest-VolumesExtendTest-1009967172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-23954b37-ac7f-4a08-a90f-e817a88a5e5c tempest-VolumesExtendTest-1009967172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-23954b37-ac7f-4a08-a90f-e817a88a5e5c tempest-VolumesExtendTest-1009967172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-23954b37-ac7f-4a08-a90f-e817a88a5e5c tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:05 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:41:05 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:05 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d5ed8b7f-e063-4461-8beb-27ff6a7dbd38 tempest-VolumesActionsTest-1249116603 None] Acquiring lock "cinder-13c44d92-02d8-4913-b2ce-4b25bcd34f2d-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:05 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-23954b37-ac7f-4a08-a90f-e817a88a5e5c tempest-VolumesExtendTest-1009967172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.280s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:05 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-23954b37-ac7f-4a08-a90f-e817a88a5e5c tempest-VolumesExtendTest-1009967172 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:41:05 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-23954b37-ac7f-4a08-a90f-e817a88a5e5c tempest-VolumesExtendTest-1009967172 None] Deleted volume successfully. Nov 06 18:41:05 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d5ed8b7f-e063-4461-8beb-27ff6a7dbd38 tempest-VolumesActionsTest-1249116603 None] Lock "cinder-13c44d92-02d8-4913-b2ce-4b25bcd34f2d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:05 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-23954b37-ac7f-4a08-a90f-e817a88a5e5c tempest-VolumesExtendTest-1009967172 None] Lock "cinder-971189e1-f2eb-4e17-8ce3-4cf54845a72c-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:05 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d5ed8b7f-e063-4461-8beb-27ff6a7dbd38 tempest-VolumesActionsTest-1249116603 None] Acquiring lock "cinder-quobyte-13c44d92-02d8-4913-b2ce-4b25bcd34f2d" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:05 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d5ed8b7f-e063-4461-8beb-27ff6a7dbd38 tempest-VolumesActionsTest-1249116603 None] Lock "cinder-quobyte-13c44d92-02d8-4913-b2ce-4b25bcd34f2d" acquired by "delete_volume" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:05 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[85973e1f-7a2c-4eae-98a2-667ae4f2cd72]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d5ed8b7f-e063-4461-8beb-27ff6a7dbd38 tempest-VolumesActionsTest-1249116603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-13c44d92-02d8-4913-b2ce-4b25bcd34f2d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:05 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-13c44d92-02d8-4913-b2ce-4b25bcd34f2d Nov 06 18:41:05 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:05 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d5ed8b7f-e063-4461-8beb-27ff6a7dbd38 tempest-VolumesActionsTest-1249116603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-13c44d92-02d8-4913-b2ce-4b25bcd34f2d" returned: 0 in 0.393s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d5ed8b7f-e063-4461-8beb-27ff6a7dbd38 tempest-VolumesActionsTest-1249116603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-13c44d92-02d8-4913-b2ce-4b25bcd34f2d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:05 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-13c44d92-02d8-4913-b2ce-4b25bcd34f2d Nov 06 18:41:05 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:06 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d5ed8b7f-e063-4461-8beb-27ff6a7dbd38 tempest-VolumesActionsTest-1249116603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-13c44d92-02d8-4913-b2ce-4b25bcd34f2d" returned: 0 in 0.371s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d5ed8b7f-e063-4461-8beb-27ff6a7dbd38 tempest-VolumesActionsTest-1249116603 None] Lock "cinder-quobyte-13c44d92-02d8-4913-b2ce-4b25bcd34f2d" released by "delete_volume" :: held 0.812s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:06 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-d5ed8b7f-e063-4461-8beb-27ff6a7dbd38 tempest-VolumesActionsTest-1249116603 None] Created reservations ['8ff6d672-0a66-48f6-a59d-aefee57f3f4e', '07fbe4b5-b6c2-4cec-a139-942758d43866', '357d86c5-ccf2-4c15-9d73-ef2a604bb6f1', '1bb35b14-04ab-458f-8b86-f91420c7d31a'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:41:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d5ed8b7f-e063-4461-8beb-27ff6a7dbd38 tempest-VolumesActionsTest-1249116603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d5ed8b7f-e063-4461-8beb-27ff6a7dbd38 tempest-VolumesActionsTest-1249116603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d5ed8b7f-e063-4461-8beb-27ff6a7dbd38 tempest-VolumesActionsTest-1249116603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d5ed8b7f-e063-4461-8beb-27ff6a7dbd38 tempest-VolumesActionsTest-1249116603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d5ed8b7f-e063-4461-8beb-27ff6a7dbd38 tempest-VolumesActionsTest-1249116603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d5ed8b7f-e063-4461-8beb-27ff6a7dbd38 tempest-VolumesActionsTest-1249116603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:06 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:41:06 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:06 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-f058244b-6d3b-4879-a2cf-2450b09ef241 req-01c5e697-cdad-4142-a859-1e1b9b7965dd tempest-AttachVolumeTestJSON-901828419 None] Terminate volume connection completed successfully. Nov 06 18:41:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-f058244b-6d3b-4879-a2cf-2450b09ef241 req-01c5e697-cdad-4142-a859-1e1b9b7965dd tempest-AttachVolumeTestJSON-901828419 None] Deleting attachment 0d855145-aff4-45de-aa5b-c963e7d34c00. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:41:06 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d5ed8b7f-e063-4461-8beb-27ff6a7dbd38 tempest-VolumesActionsTest-1249116603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.437s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:06 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-d5ed8b7f-e063-4461-8beb-27ff6a7dbd38 tempest-VolumesActionsTest-1249116603 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:41:06 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-d5ed8b7f-e063-4461-8beb-27ff6a7dbd38 tempest-VolumesActionsTest-1249116603 None] Deleted volume successfully. Nov 06 18:41:06 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:41:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Flow 'volume_create_manager' (c81c42ff-1378-4ec2-983b-d8bb620465ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:41:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3377b8b-6b61-438b-ba0c-5516ee981338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3377b8b-6b61-438b-ba0c-5516ee981338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-870457785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=393cce5a-4b7d-4b53-a87c-7798cdfdfa0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b99ae4d2227d4253972c42fe378e6a84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:41:07Z,use_quota=True,user_id='c5a70fa39fc8495abf97e1bf501656e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99036a09-d179-4a31-a228-087cf6003add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99036a09-d179-4a31-a228-087cf6003add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffdcaf7-5fc5-4ef8-aae1-9adbf84275cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffdcaf7-5fc5-4ef8-aae1-9adbf84275cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '393cce5a-4b7d-4b53-a87c-7798cdfdfa0a', 'volume_name': 'volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34a409c-e59e-47dd-af47-6285008e0699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34a409c-e59e-47dd-af47-6285008e0699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a36f01-e2bb-4793-a8de-0d9f72d9848a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:07 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Volume 393cce5a-4b7d-4b53-a87c-7798cdfdfa0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a', 'volume_size': 1} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-870457785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=393cce5a-4b7d-4b53-a87c-7798cdfdfa0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b99ae4d2227d4253972c42fe378e6a84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:41:07Z,use_quota=True,user_id='c5a70fa39fc8495abf97e1bf501656e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Creating volume 393cce5a-4b7d-4b53-a87c-7798cdfdfa0a {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:41:07 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d5ed8b7f-e063-4461-8beb-27ff6a7dbd38 tempest-VolumesActionsTest-1249116603 None] Lock "cinder-13c44d92-02d8-4913-b2ce-4b25bcd34f2d-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:07 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a 1073741824 Nov 06 18:41:07 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Flow 'volume_create_manager' (f3ec2428-3194-4b54-abd7-2def52ff103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c18f358-12f6-45d7-a24b-3de02dc028c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c18f358-12f6-45d7-a24b-3de02dc028c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-58532378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ddef15-2be3-47a8-be8f-1e06fe257c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b14ce1cfe6344ab918995f59d968557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:41:07Z,use_quota=True,user_id='c1b9419f46014a368af4af5044a074f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4201cf05-461d-4d34-9fe1-67c981f10a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4201cf05-461d-4d34-9fe1-67c981f10a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45f1f5c-6845-42fe-bacd-062c769cbfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45f1f5c-6845-42fe-bacd-062c769cbfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77ddef15-2be3-47a8-be8f-1e06fe257c58', 'volume_name': 'volume-77ddef15-2be3-47a8-be8f-1e06fe257c58', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cac1367-d887-4230-84bf-94114cdaecb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cac1367-d887-4230-84bf-94114cdaecb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69494c04-f487-4978-ab7d-b2c06fa7288b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:07 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Volume 77ddef15-2be3-47a8-be8f-1e06fe257c58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77ddef15-2be3-47a8-be8f-1e06fe257c58', 'volume_size': 1} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:07 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a 1073741824" returned: 0 in 0.644s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:07 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a Nov 06 18:41:07 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:08 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a" returned: 0 in 0.308s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:41:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.581s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-58532378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ddef15-2be3-47a8-be8f-1e06fe257c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b14ce1cfe6344ab918995f59d968557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:41:07Z,use_quota=True,user_id='c1b9419f46014a368af4af5044a074f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:41:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Creating volume 77ddef15-2be3-47a8-be8f-1e06fe257c58 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:41:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:41:08 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:41:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-77ddef15-2be3-47a8-be8f-1e06fe257c58 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a36f01-e2bb-4793-a8de-0d9f72d9848a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:08 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-77ddef15-2be3-47a8-be8f-1e06fe257c58 1073741824 Nov 06 18:41:08 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a058fc40-8564-4607-84e7-f37229cf3f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:08 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Volume volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a (393cce5a-4b7d-4b53-a87c-7798cdfdfa0a): created successfully Nov 06 18:41:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a058fc40-8564-4607-84e7-f37229cf3f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Flow 'volume_create_manager' (c81c42ff-1378-4ec2-983b-d8bb620465ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:41:08 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-584288e6-8e11-45dc-adf8-6b1251fd172f tempest-VolumesExtendTest-1009967172 None] Created volume successfully. Nov 06 18:41:08 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-6c89ba16-d36f-4d59-a957-f446348e0cad req-b782fa8d-d8c1-4157-9b27-b5e62034d453 tempest-AttachVolumeTestJSON-901828419 None] Terminate volume connection completed successfully. Nov 06 18:41:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-6c89ba16-d36f-4d59-a957-f446348e0cad req-b782fa8d-d8c1-4157-9b27-b5e62034d453 tempest-AttachVolumeTestJSON-901828419 None] Deleting attachment 26509009-bd08-40d6-9528-592f6665462d. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:41:08 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-77ddef15-2be3-47a8-be8f-1e06fe257c58 1073741824" returned: 0 in 0.561s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-77ddef15-2be3-47a8-be8f-1e06fe257c58 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:08 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-77ddef15-2be3-47a8-be8f-1e06fe257c58 Nov 06 18:41:08 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:09 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-77ddef15-2be3-47a8-be8f-1e06fe257c58" returned: 0 in 0.355s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:41:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69494c04-f487-4978-ab7d-b2c06fa7288b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77ddef15-2be3-47a8-be8f-1e06fe257c58', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa2da3b-eaf1-49ae-b878-9b02dc80f4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:09 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Volume volume-77ddef15-2be3-47a8-be8f-1e06fe257c58 (77ddef15-2be3-47a8-be8f-1e06fe257c58): created successfully Nov 06 18:41:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa2da3b-eaf1-49ae-b878-9b02dc80f4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Flow 'volume_create_manager' (f3ec2428-3194-4b54-abd7-2def52ff103c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:41:09 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-8654307b-f5a7-4cf2-9220-0afb443e51b7 tempest-VolumesActionsTest-418687457 None] Created volume successfully. Nov 06 18:41:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-876b69fa-e25e-4ecd-a942-b2e17f22fccf tempest-VolumesExtendTest-1009967172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-876b69fa-e25e-4ecd-a942-b2e17f22fccf tempest-VolumesExtendTest-1009967172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-876b69fa-e25e-4ecd-a942-b2e17f22fccf tempest-VolumesExtendTest-1009967172 None] Creating offline snapshot a2bdca6b-4770-4b80-b7e1-be166904ac4e of volume 393cce5a-4b7d-4b53-a87c-7798cdfdfa0a {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:41:09 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[c659bde9-d41b-486a-9282-fb0c422dd191]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-876b69fa-e25e-4ecd-a942-b2e17f22fccf tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:09 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a Nov 06 18:41:09 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:09 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-876b69fa-e25e-4ecd-a942-b2e17f22fccf tempest-VolumesExtendTest-1009967172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a" returned: 0 in 0.569s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-876b69fa-e25e-4ecd-a942-b2e17f22fccf tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:10 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e 1G Nov 06 18:41:10 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6bb056e0-4aba-4c46-ad90-ef7f2d4bacd1 tempest-VolumesActionsTest-418687457 None] Acquiring lock "cinder-77ddef15-2be3-47a8-be8f-1e06fe257c58-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6bb056e0-4aba-4c46-ad90-ef7f2d4bacd1 tempest-VolumesActionsTest-418687457 None] Lock "cinder-77ddef15-2be3-47a8-be8f-1e06fe257c58-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6bb056e0-4aba-4c46-ad90-ef7f2d4bacd1 tempest-VolumesActionsTest-418687457 None] Acquiring lock "cinder-quobyte-77ddef15-2be3-47a8-be8f-1e06fe257c58" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6bb056e0-4aba-4c46-ad90-ef7f2d4bacd1 tempest-VolumesActionsTest-418687457 None] Lock "cinder-quobyte-77ddef15-2be3-47a8-be8f-1e06fe257c58" acquired by "delete_volume" :: waited 0.036s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:10 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[6629bf3d-d4db-46b3-b8ee-04f0de28b6d7]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6bb056e0-4aba-4c46-ad90-ef7f2d4bacd1 tempest-VolumesActionsTest-418687457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-77ddef15-2be3-47a8-be8f-1e06fe257c58 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:10 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-876b69fa-e25e-4ecd-a942-b2e17f22fccf tempest-VolumesExtendTest-1009967172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e 1G" returned: 0 in 0.899s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-876b69fa-e25e-4ecd-a942-b2e17f22fccf tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:10 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e Nov 06 18:41:10 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:11 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-77ddef15-2be3-47a8-be8f-1e06fe257c58 Nov 06 18:41:11 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:11 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-876b69fa-e25e-4ecd-a942-b2e17f22fccf tempest-VolumesExtendTest-1009967172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e" returned: 0 in 0.444s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:11 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-876b69fa-e25e-4ecd-a942-b2e17f22fccf tempest-VolumesExtendTest-1009967172 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e is being set with open permissions: ugo+rw Nov 06 18:41:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-876b69fa-e25e-4ecd-a942-b2e17f22fccf tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:11 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e Nov 06 18:41:11 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:11 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6bb056e0-4aba-4c46-ad90-ef7f2d4bacd1 tempest-VolumesActionsTest-418687457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-77ddef15-2be3-47a8-be8f-1e06fe257c58" returned: 0 in 0.679s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6bb056e0-4aba-4c46-ad90-ef7f2d4bacd1 tempest-VolumesActionsTest-418687457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-77ddef15-2be3-47a8-be8f-1e06fe257c58 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:11 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-77ddef15-2be3-47a8-be8f-1e06fe257c58 Nov 06 18:41:11 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:11 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-876b69fa-e25e-4ecd-a942-b2e17f22fccf tempest-VolumesExtendTest-1009967172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e" returned: 0 in 0.384s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-876b69fa-e25e-4ecd-a942-b2e17f22fccf tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:11 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.info Nov 06 18:41:11 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:12 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6bb056e0-4aba-4c46-ad90-ef7f2d4bacd1 tempest-VolumesActionsTest-418687457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-77ddef15-2be3-47a8-be8f-1e06fe257c58" returned: 0 in 0.536s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:12 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6bb056e0-4aba-4c46-ad90-ef7f2d4bacd1 tempest-VolumesActionsTest-418687457 None] Lock "cinder-quobyte-77ddef15-2be3-47a8-be8f-1e06fe257c58" released by "delete_volume" :: held 1.285s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:12 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-6bb056e0-4aba-4c46-ad90-ef7f2d4bacd1 tempest-VolumesActionsTest-418687457 None] Created reservations ['4b5bbaa4-57a7-461b-bdc6-c1e981223e04', '0cfa2bf8-d981-4cb3-8853-34a5c78f5549', '63fb7d06-dd46-43f9-898a-58edae392fab', 'dc1167e5-dd3a-45d9-9f46-db7d00c8d21d'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:41:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6bb056e0-4aba-4c46-ad90-ef7f2d4bacd1 tempest-VolumesActionsTest-418687457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6bb056e0-4aba-4c46-ad90-ef7f2d4bacd1 tempest-VolumesActionsTest-418687457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:12 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6bb056e0-4aba-4c46-ad90-ef7f2d4bacd1 tempest-VolumesActionsTest-418687457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:12 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6bb056e0-4aba-4c46-ad90-ef7f2d4bacd1 tempest-VolumesActionsTest-418687457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6bb056e0-4aba-4c46-ad90-ef7f2d4bacd1 tempest-VolumesActionsTest-418687457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6bb056e0-4aba-4c46-ad90-ef7f2d4bacd1 tempest-VolumesActionsTest-418687457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:12 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-876b69fa-e25e-4ecd-a942-b2e17f22fccf tempest-VolumesExtendTest-1009967172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.info" returned: 0 in 0.576s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:12 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-876b69fa-e25e-4ecd-a942-b2e17f22fccf tempest-VolumesExtendTest-1009967172 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.info is being set with open permissions: ugo+rw Nov 06 18:41:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-876b69fa-e25e-4ecd-a942-b2e17f22fccf tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:12 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.info Nov 06 18:41:12 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:12 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:41:12 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:12 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-876b69fa-e25e-4ecd-a942-b2e17f22fccf tempest-VolumesExtendTest-1009967172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.info" returned: 0 in 0.403s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-876b69fa-e25e-4ecd-a942-b2e17f22fccf tempest-VolumesExtendTest-1009967172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.459s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:12 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-876b69fa-e25e-4ecd-a942-b2e17f22fccf tempest-VolumesExtendTest-1009967172 None] Create snapshot completed successfully Nov 06 18:41:12 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6bb056e0-4aba-4c46-ad90-ef7f2d4bacd1 tempest-VolumesActionsTest-418687457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.515s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:12 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-6bb056e0-4aba-4c46-ad90-ef7f2d4bacd1 tempest-VolumesActionsTest-418687457 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:41:12 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-6bb056e0-4aba-4c46-ad90-ef7f2d4bacd1 tempest-VolumesActionsTest-418687457 None] Deleted volume successfully. Nov 06 18:41:12 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6bb056e0-4aba-4c46-ad90-ef7f2d4bacd1 tempest-VolumesActionsTest-418687457 None] Lock "cinder-77ddef15-2be3-47a8-be8f-1e06fe257c58-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0265f945-4536-4c3b-97bf-9b574dd761c3 tempest-VolumesExtendTest-1009967172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0265f945-4536-4c3b-97bf-9b574dd761c3 tempest-VolumesExtendTest-1009967172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:13 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[738b460f-1f48-4d94-89a1-8d51afca4561]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0265f945-4536-4c3b-97bf-9b574dd761c3 tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:13 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a Nov 06 18:41:13 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:14 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0265f945-4536-4c3b-97bf-9b574dd761c3 tempest-VolumesExtendTest-1009967172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a" returned: 0 in 0.405s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0265f945-4536-4c3b-97bf-9b574dd761c3 tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e 2G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0265f945-4536-4c3b-97bf-9b574dd761c3 tempest-VolumesExtendTest-1009967172 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e 2G" returned: 0 in 0.204s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0265f945-4536-4c3b-97bf-9b574dd761c3 tempest-VolumesExtendTest-1009967172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.657s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:14 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-97b93e18-666d-49ea-bfc9-ce619c110120 tempest-AttachVolumeTestJSON-901828419 None] Acquiring lock "cinder-dd87016f-7ea9-47ad-89ad-76da644de219-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:14 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-97b93e18-666d-49ea-bfc9-ce619c110120 tempest-AttachVolumeTestJSON-901828419 None] Lock "cinder-dd87016f-7ea9-47ad-89ad-76da644de219-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:14 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-0265f945-4536-4c3b-97bf-9b574dd761c3 tempest-VolumesExtendTest-1009967172 None] Extend volume completed successfully. Nov 06 18:41:14 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-97b93e18-666d-49ea-bfc9-ce619c110120 tempest-AttachVolumeTestJSON-901828419 None] Acquiring lock "cinder-quobyte-dd87016f-7ea9-47ad-89ad-76da644de219" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:14 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-97b93e18-666d-49ea-bfc9-ce619c110120 tempest-AttachVolumeTestJSON-901828419 None] Lock "cinder-quobyte-dd87016f-7ea9-47ad-89ad-76da644de219" acquired by "delete_volume" :: waited 0.017s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:14 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef3878f-e597-44b9-b035-1ec1f2a7c8fb]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-97b93e18-666d-49ea-bfc9-ce619c110120 tempest-AttachVolumeTestJSON-901828419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dd87016f-7ea9-47ad-89ad-76da644de219 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:14 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dd87016f-7ea9-47ad-89ad-76da644de219 Nov 06 18:41:14 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:15 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-97b93e18-666d-49ea-bfc9-ce619c110120 tempest-AttachVolumeTestJSON-901828419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dd87016f-7ea9-47ad-89ad-76da644de219" returned: 0 in 0.419s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-97b93e18-666d-49ea-bfc9-ce619c110120 tempest-AttachVolumeTestJSON-901828419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dd87016f-7ea9-47ad-89ad-76da644de219 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:15 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dd87016f-7ea9-47ad-89ad-76da644de219 Nov 06 18:41:15 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] Acquiring lock "cinder-a2bdca6b-4770-4b80-b7e1-be166904ac4e-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] Lock "cinder-a2bdca6b-4770-4b80-b7e1-be166904ac4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] Acquiring lock "cinder-quobyte-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] Lock "cinder-quobyte-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] Acquiring lock "cinder-quobyte-a2bdca6b-4770-4b80-b7e1-be166904ac4e" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] Lock "cinder-quobyte-a2bdca6b-4770-4b80-b7e1-be166904ac4e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] Deleting offline snapshot a2bdca6b-4770-4b80-b7e1-be166904ac4e of volume 393cce5a-4b7d-4b53-a87c-7798cdfdfa0a {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] snapshot_file for this snap is: volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e7d32e-4f00-491c-9915-f20a3a53a2f6]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:15 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e Nov 06 18:41:15 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:15 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-97b93e18-666d-49ea-bfc9-ce619c110120 tempest-AttachVolumeTestJSON-901828419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dd87016f-7ea9-47ad-89ad-76da644de219" returned: 0 in 0.299s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-97b93e18-666d-49ea-bfc9-ce619c110120 tempest-AttachVolumeTestJSON-901828419 None] Lock "cinder-quobyte-dd87016f-7ea9-47ad-89ad-76da644de219" released by "delete_volume" :: held 0.773s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-97b93e18-666d-49ea-bfc9-ce619c110120 tempest-AttachVolumeTestJSON-901828419 None] Created reservations ['1f258c03-8b65-4ccf-8ce8-0398ad89711c', 'c3829460-fd55-45ac-b257-d6cb4a855b93', 'a6e5bc20-5963-44e2-b3d0-8055950d7777', '2b38d794-e96b-43d5-88a0-4805031a5f45'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-97b93e18-666d-49ea-bfc9-ce619c110120 tempest-AttachVolumeTestJSON-901828419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-97b93e18-666d-49ea-bfc9-ce619c110120 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-97b93e18-666d-49ea-bfc9-ce619c110120 tempest-AttachVolumeTestJSON-901828419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-97b93e18-666d-49ea-bfc9-ce619c110120 tempest-AttachVolumeTestJSON-901828419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-97b93e18-666d-49ea-bfc9-ce619c110120 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-97b93e18-666d-49ea-bfc9-ce619c110120 tempest-AttachVolumeTestJSON-901828419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:15 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:41:15 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:15 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e" returned: 0 in 0.398s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4bbc52-258c-4600-b671-c3d8d2820f56]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-44a4271c-b322-4ef9-a9ae-a32150e3f171 tempest-AttachVolumeTestJSON-901828419 None] Acquiring lock "cinder-5bfdc8f6-3d04-40af-b579-ffadacd169a2-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-44a4271c-b322-4ef9-a9ae-a32150e3f171 tempest-AttachVolumeTestJSON-901828419 None] Lock "cinder-5bfdc8f6-3d04-40af-b579-ffadacd169a2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-44a4271c-b322-4ef9-a9ae-a32150e3f171 tempest-AttachVolumeTestJSON-901828419 None] Acquiring lock "cinder-quobyte-5bfdc8f6-3d04-40af-b579-ffadacd169a2" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:15 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-44a4271c-b322-4ef9-a9ae-a32150e3f171 tempest-AttachVolumeTestJSON-901828419 None] Lock "cinder-quobyte-5bfdc8f6-3d04-40af-b579-ffadacd169a2" acquired by "delete_volume" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:15 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:15 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-97b93e18-666d-49ea-bfc9-ce619c110120 tempest-AttachVolumeTestJSON-901828419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.373s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-97b93e18-666d-49ea-bfc9-ce619c110120 tempest-AttachVolumeTestJSON-901828419 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:41:15 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-97b93e18-666d-49ea-bfc9-ce619c110120 tempest-AttachVolumeTestJSON-901828419 None] Deleted volume successfully. Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c8a959-f0aa-44c4-8803-ba4135ab8552]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-44a4271c-b322-4ef9-a9ae-a32150e3f171 tempest-AttachVolumeTestJSON-901828419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5bfdc8f6-3d04-40af-b579-ffadacd169a2 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-97b93e18-666d-49ea-bfc9-ce619c110120 tempest-AttachVolumeTestJSON-901828419 None] Lock "cinder-dd87016f-7ea9-47ad-89ad-76da644de219-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:15 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5bfdc8f6-3d04-40af-b579-ffadacd169a2 Nov 06 18:41:15 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:16 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a" returned: 0 in 0.466s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:16 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e Nov 06 18:41:16 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:16 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-44a4271c-b322-4ef9-a9ae-a32150e3f171 tempest-AttachVolumeTestJSON-901828419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5bfdc8f6-3d04-40af-b579-ffadacd169a2" returned: 0 in 0.395s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-44a4271c-b322-4ef9-a9ae-a32150e3f171 tempest-AttachVolumeTestJSON-901828419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5bfdc8f6-3d04-40af-b579-ffadacd169a2 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:16 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5bfdc8f6-3d04-40af-b579-ffadacd169a2 Nov 06 18:41:16 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:16 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e" returned: 0 in 0.411s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:16 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-44a4271c-b322-4ef9-a9ae-a32150e3f171 tempest-AttachVolumeTestJSON-901828419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5bfdc8f6-3d04-40af-b579-ffadacd169a2" returned: 0 in 0.279s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:16 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e Nov 06 18:41:16 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-44a4271c-b322-4ef9-a9ae-a32150e3f171 tempest-AttachVolumeTestJSON-901828419 None] Lock "cinder-quobyte-5bfdc8f6-3d04-40af-b579-ffadacd169a2" released by "delete_volume" :: held 0.738s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:16 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-44a4271c-b322-4ef9-a9ae-a32150e3f171 tempest-AttachVolumeTestJSON-901828419 None] Created reservations ['b972f40d-b7c9-4a91-b212-39607ec5a996', '491ab3e2-1cf4-4f4d-a9db-fb2e583a3bb6', '96e4b876-12a5-4e65-8932-0f0d552cf509', 'f3c827eb-2287-4f92-b492-639389da056f'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:41:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-44a4271c-b322-4ef9-a9ae-a32150e3f171 tempest-AttachVolumeTestJSON-901828419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-44a4271c-b322-4ef9-a9ae-a32150e3f171 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-44a4271c-b322-4ef9-a9ae-a32150e3f171 tempest-AttachVolumeTestJSON-901828419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-44a4271c-b322-4ef9-a9ae-a32150e3f171 tempest-AttachVolumeTestJSON-901828419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-44a4271c-b322-4ef9-a9ae-a32150e3f171 tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-44a4271c-b322-4ef9-a9ae-a32150e3f171 tempest-AttachVolumeTestJSON-901828419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:16 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:41:16 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:16 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a.a2bdca6b-4770-4b80-b7e1-be166904ac4e" returned: 0 in 0.363s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] Lock "cinder-quobyte-a2bdca6b-4770-4b80-b7e1-be166904ac4e" released by "_delete_snapshot" :: held 1.809s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] Lock "cinder-quobyte-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a" released by "delete_snapshot" :: held 1.848s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] Created reservations ['04d150d4-a75b-45d8-a58e-30fb7a3bd986', '7deffb6d-a5e6-4b20-b3a2-7a9f59920543', '1a6c4ef7-a573-489d-8162-86f733660a36', 'a140ff25-56ef-4f63-b7c3-c0b481f6a7e9'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-560d3a62-041e-4c53-9200-a3b6365d15cb tempest-AttachVolumeTestJSON-901828419 None] Acquiring lock "cinder-f230d141-aa56-43d9-b9b7-300f22c0c696-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-560d3a62-041e-4c53-9200-a3b6365d15cb tempest-AttachVolumeTestJSON-901828419 None] Lock "cinder-f230d141-aa56-43d9-b9b7-300f22c0c696-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-560d3a62-041e-4c53-9200-a3b6365d15cb tempest-AttachVolumeTestJSON-901828419 None] Acquiring lock "cinder-quobyte-f230d141-aa56-43d9-b9b7-300f22c0c696" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:17 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-44a4271c-b322-4ef9-a9ae-a32150e3f171 tempest-AttachVolumeTestJSON-901828419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.426s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-44a4271c-b322-4ef9-a9ae-a32150e3f171 tempest-AttachVolumeTestJSON-901828419 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:41:17 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-44a4271c-b322-4ef9-a9ae-a32150e3f171 tempest-AttachVolumeTestJSON-901828419 None] Deleted volume successfully. Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-560d3a62-041e-4c53-9200-a3b6365d15cb tempest-AttachVolumeTestJSON-901828419 None] Lock "cinder-quobyte-f230d141-aa56-43d9-b9b7-300f22c0c696" acquired by "delete_volume" :: waited 0.042s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:17 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] Delete snapshot completed successfully. Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-87db921d-4117-4a94-9c33-ef277308b922 tempest-VolumesExtendTest-1009967172 None] Lock "cinder-a2bdca6b-4770-4b80-b7e1-be166904ac4e-delete_snapshot" released by "delete_snapshot" :: held 2.144s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[e413bff3-e8bb-4e09-a6ee-a47bb5c158d1]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-560d3a62-041e-4c53-9200-a3b6365d15cb tempest-AttachVolumeTestJSON-901828419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f230d141-aa56-43d9-b9b7-300f22c0c696 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-44a4271c-b322-4ef9-a9ae-a32150e3f171 tempest-AttachVolumeTestJSON-901828419 None] Lock "cinder-5bfdc8f6-3d04-40af-b579-ffadacd169a2-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d4447af5-7e2c-46b1-8cc9-f265ac7c20e3 tempest-VolumesExtendTest-1009967172 None] Acquiring lock "cinder-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d4447af5-7e2c-46b1-8cc9-f265ac7c20e3 tempest-VolumesExtendTest-1009967172 None] Lock "cinder-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:17 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f230d141-aa56-43d9-b9b7-300f22c0c696 Nov 06 18:41:17 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d4447af5-7e2c-46b1-8cc9-f265ac7c20e3 tempest-VolumesExtendTest-1009967172 None] Acquiring lock "cinder-quobyte-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d4447af5-7e2c-46b1-8cc9-f265ac7c20e3 tempest-VolumesExtendTest-1009967172 None] Lock "cinder-quobyte-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a" acquired by "delete_volume" :: waited 0.017s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad79c0d3-441c-463b-a503-8635ed229d05]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d4447af5-7e2c-46b1-8cc9-f265ac7c20e3 tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:17 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a Nov 06 18:41:17 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:17 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-560d3a62-041e-4c53-9200-a3b6365d15cb tempest-AttachVolumeTestJSON-901828419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f230d141-aa56-43d9-b9b7-300f22c0c696" returned: 0 in 0.488s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-560d3a62-041e-4c53-9200-a3b6365d15cb tempest-AttachVolumeTestJSON-901828419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f230d141-aa56-43d9-b9b7-300f22c0c696 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:17 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f230d141-aa56-43d9-b9b7-300f22c0c696 Nov 06 18:41:17 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:17 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d4447af5-7e2c-46b1-8cc9-f265ac7c20e3 tempest-VolumesExtendTest-1009967172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a" returned: 0 in 0.513s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d4447af5-7e2c-46b1-8cc9-f265ac7c20e3 tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:18 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a Nov 06 18:41:18 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:18 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-560d3a62-041e-4c53-9200-a3b6365d15cb tempest-AttachVolumeTestJSON-901828419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f230d141-aa56-43d9-b9b7-300f22c0c696" returned: 0 in 0.321s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-560d3a62-041e-4c53-9200-a3b6365d15cb tempest-AttachVolumeTestJSON-901828419 None] Lock "cinder-quobyte-f230d141-aa56-43d9-b9b7-300f22c0c696" released by "delete_volume" :: held 0.889s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-560d3a62-041e-4c53-9200-a3b6365d15cb tempest-AttachVolumeTestJSON-901828419 None] Created reservations ['9c3c19e7-59af-4a14-82dc-da2eccdc68b6', '7c570c03-6ea6-4fab-95dc-78d03682ec98', 'b12a4a61-f2cd-43be-ba86-5a53c3794b3a', 'd9be38a9-412c-472d-97c4-6bd298b5104e'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-560d3a62-041e-4c53-9200-a3b6365d15cb tempest-AttachVolumeTestJSON-901828419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-560d3a62-041e-4c53-9200-a3b6365d15cb tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-560d3a62-041e-4c53-9200-a3b6365d15cb tempest-AttachVolumeTestJSON-901828419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-560d3a62-041e-4c53-9200-a3b6365d15cb tempest-AttachVolumeTestJSON-901828419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-560d3a62-041e-4c53-9200-a3b6365d15cb tempest-AttachVolumeTestJSON-901828419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-560d3a62-041e-4c53-9200-a3b6365d15cb tempest-AttachVolumeTestJSON-901828419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:18 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:41:18 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:18 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d4447af5-7e2c-46b1-8cc9-f265ac7c20e3 tempest-VolumesExtendTest-1009967172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a" returned: 0 in 0.376s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d4447af5-7e2c-46b1-8cc9-f265ac7c20e3 tempest-VolumesExtendTest-1009967172 None] Lock "cinder-quobyte-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a" released by "delete_volume" :: held 0.966s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-d4447af5-7e2c-46b1-8cc9-f265ac7c20e3 tempest-VolumesExtendTest-1009967172 None] Created reservations ['06a91fea-5186-4a7f-9a76-4c682ba6d5fd', 'a3e67541-51ee-424f-bdb8-a5fc9ef9db48', '98771d32-dcbf-45e7-83f9-7c3da522e4f5', 'c256e620-564a-4eeb-b8c4-82d3460dc14d'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d4447af5-7e2c-46b1-8cc9-f265ac7c20e3 tempest-VolumesExtendTest-1009967172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d4447af5-7e2c-46b1-8cc9-f265ac7c20e3 tempest-VolumesExtendTest-1009967172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d4447af5-7e2c-46b1-8cc9-f265ac7c20e3 tempest-VolumesExtendTest-1009967172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d4447af5-7e2c-46b1-8cc9-f265ac7c20e3 tempest-VolumesExtendTest-1009967172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d4447af5-7e2c-46b1-8cc9-f265ac7c20e3 tempest-VolumesExtendTest-1009967172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d4447af5-7e2c-46b1-8cc9-f265ac7c20e3 tempest-VolumesExtendTest-1009967172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:18 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-560d3a62-041e-4c53-9200-a3b6365d15cb tempest-AttachVolumeTestJSON-901828419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.270s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-560d3a62-041e-4c53-9200-a3b6365d15cb tempest-AttachVolumeTestJSON-901828419 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:41:18 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:41:18 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:18 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-560d3a62-041e-4c53-9200-a3b6365d15cb tempest-AttachVolumeTestJSON-901828419 None] Deleted volume successfully. Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-560d3a62-041e-4c53-9200-a3b6365d15cb tempest-AttachVolumeTestJSON-901828419 None] Lock "cinder-f230d141-aa56-43d9-b9b7-300f22c0c696-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:18 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d4447af5-7e2c-46b1-8cc9-f265ac7c20e3 tempest-VolumesExtendTest-1009967172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.263s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-d4447af5-7e2c-46b1-8cc9-f265ac7c20e3 tempest-VolumesExtendTest-1009967172 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:41:18 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-d4447af5-7e2c-46b1-8cc9-f265ac7c20e3 tempest-VolumesExtendTest-1009967172 None] Deleted volume successfully. Nov 06 18:41:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d4447af5-7e2c-46b1-8cc9-f265ac7c20e3 tempest-VolumesExtendTest-1009967172 None] Lock "cinder-393cce5a-4b7d-4b53-a87c-7798cdfdfa0a-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:24 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:41:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Flow 'volume_create_manager' (03e84cd8-c19e-4791-9b3e-f834f442b348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:41:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dcfac6a-6715-4459-9849-9f554661c0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dcfac6a-6715-4459-9849-9f554661c0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1971255626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f001f7a424499ba4f620e8a7701487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:41:25Z,use_quota=True,user_id='964faefa0d0543ae9f3e6acb88b861fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (108e0656-5c2d-49b0-9084-efc2f1fcacf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (108e0656-5c2d-49b0-9084-efc2f1fcacf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a69e19-7b50-479f-b1b1-6df06c010f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a69e19-7b50-479f-b1b1-6df06c010f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6', 'volume_name': 'volume-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e7db65-ed20-4e0a-87d9-f3a80e2b19de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e7db65-ed20-4e0a-87d9-f3a80e2b19de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c9ed09-c042-423d-9caf-020b6b2a0830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:25 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Volume 0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6', 'volume_size': 1} Nov 06 18:41:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1971255626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f001f7a424499ba4f620e8a7701487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:41:25Z,use_quota=True,user_id='964faefa0d0543ae9f3e6acb88b861fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:41:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Creating volume 0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:41:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:41:25 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:41:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:25 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6 1073741824 Nov 06 18:41:25 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:25 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6 1073741824" returned: 0 in 0.725s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:25 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6 Nov 06 18:41:25 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:26 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6" returned: 0 in 0.310s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:26 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:41:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c9ed09-c042-423d-9caf-020b6b2a0830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1fc23b-91a0-4d1b-a707-9800f1bdce1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:26 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Volume volume-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6 (0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6): created successfully Nov 06 18:41:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1fc23b-91a0-4d1b-a707-9800f1bdce1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Flow 'volume_create_manager' (03e84cd8-c19e-4791-9b3e-f834f442b348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:41:26 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-bc7cdbe6-1cc4-4654-ae7c-bde267565e73 tempest-AttachVolumeNegativeTest-672322174 None] Created volume successfully. Nov 06 18:41:28 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:UPDATE=169,cinder:SELECT=133,cinder:DELETE=15,cinder:INSERT=44 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:41:28 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=139,cinder:UPDATE=139,cinder:INSERT=36,cinder:DELETE=10 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:41:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-223abdfc-b221-4b2c-9571-d803439b35d4 req-9b74a507-1bcb-4a57-9bbf-1fda4bc15965 tempest-AttachVolumeNegativeTest-672322174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-223abdfc-b221-4b2c-9571-d803439b35d4 req-9b74a507-1bcb-4a57-9bbf-1fda4bc15965 tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-223abdfc-b221-4b2c-9571-d803439b35d4 req-9b74a507-1bcb-4a57-9bbf-1fda4bc15965 tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-223abdfc-b221-4b2c-9571-d803439b35d4 req-9b74a507-1bcb-4a57-9bbf-1fda4bc15965 tempest-AttachVolumeNegativeTest-672322174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef47f386-e057-4aea-9890-28fdb20daa79', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:41:28 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-223abdfc-b221-4b2c-9571-d803439b35d4 req-9b74a507-1bcb-4a57-9bbf-1fda4bc15965 tempest-AttachVolumeNegativeTest-672322174 None] attachment_update completed successfully. Nov 06 18:41:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:41:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:29 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:41:29 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:29 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.493s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:41:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:41:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 29 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:41:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Flow 'volume_create_manager' (4c7331da-5f40-4ee8-9be5-a42f82af5ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac0a3d8-5733-456f-854d-7e49146c7a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac0a3d8-5733-456f-854d-7e49146c7a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1023394789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d92ca302-012b-43c1-bc08-00bb41ff67d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cd44e1edba449fb116235c8cdfef49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:41:32Z,use_quota=True,user_id='e935257568074c8586391027c922c97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77df2288-a15d-4031-8313-80480214a70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77df2288-a15d-4031-8313-80480214a70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6715e417-70e5-4b5f-934b-a23b97612d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6715e417-70e5-4b5f-934b-a23b97612d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd92ca302-012b-43c1-bc08-00bb41ff67d5', 'volume_name': 'volume-d92ca302-012b-43c1-bc08-00bb41ff67d5', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9539cf0-53a3-4490-ad5c-7201e041e837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9539cf0-53a3-4490-ad5c-7201e041e837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95eb8d79-1010-4b8f-911c-b06f2aa9436c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:31 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Volume d92ca302-012b-43c1-bc08-00bb41ff67d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d92ca302-012b-43c1-bc08-00bb41ff67d5', 'volume_size': 1} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1023394789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d92ca302-012b-43c1-bc08-00bb41ff67d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cd44e1edba449fb116235c8cdfef49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:41:32Z,use_quota=True,user_id='e935257568074c8586391027c922c97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Creating volume d92ca302-012b-43c1-bc08-00bb41ff67d5 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:41:31 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:41:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:31 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5 1073741824 Nov 06 18:41:31 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:32 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-a27a4e24-3654-434b-9375-546ff54c011a req-87af7a83-9eeb-4c34-88fa-dbf4df5d3d77 tempest-AttachVolumeNegativeTest-672322174 None] Terminate volume connection completed successfully. Nov 06 18:41:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-a27a4e24-3654-434b-9375-546ff54c011a req-87af7a83-9eeb-4c34-88fa-dbf4df5d3d77 tempest-AttachVolumeNegativeTest-672322174 None] Deleting attachment ef47f386-e057-4aea-9890-28fdb20daa79. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:41:32 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:41:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Flow 'volume_create_manager' (aac488d4-309d-4e57-a884-a8d3d5b72b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:41:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d3fff0c-3569-4131-af2f-8a94d40e03fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d3fff0c-3569-4131-af2f-8a94d40e03fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-240027414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02946bc0-8447-46b3-8c91-2c860563e003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a01be1e48249178df2f8289235a1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:41:32Z,use_quota=True,user_id='bbfe13c737e24bbdabc6517400b23d41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7654340e-069c-418a-b4e1-e196ee54c8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7654340e-069c-418a-b4e1-e196ee54c8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f6a7b5-fab5-4cbe-b24d-dc44ed464d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:32 devstack cinder-volume[86794]: DEBUG cinder.image.glance [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Creating Keystone auth plugin from conf {{(pid=86794) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 18:41:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f6a7b5-fab5-4cbe-b24d-dc44ed464d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '02946bc0-8447-46b3-8c91-2c860563e003', 'volume_name': 'volume-02946bc0-8447-46b3-8c91-2c860563e003', 'volume_size': 1, 'image_id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d57c6da8e464b1a80cefabe6e3cfecd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'created_at': datetime.datetime(2026, 11, 6, 17, 27, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 27, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1c3fab-5ed7-439f-a7dd-cba871255715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1c3fab-5ed7-439f-a7dd-cba871255715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95f8c12-08e3-423e-9a75-aadcad0e2342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:32 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Volume 02946bc0-8447-46b3-8c91-2c860563e003: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-02946bc0-8447-46b3-8c91-2c860563e003', 'volume_size': 1, 'image_id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d57c6da8e464b1a80cefabe6e3cfecd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'created_at': datetime.datetime(2026, 11, 6, 17, 27, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 27, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 18:41:32 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Trying to clone 02946bc0-8447-46b3-8c91-2c860563e003 from image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}]). {{(pid=86794) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 18:41:32 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5 1073741824" returned: 0 in 0.722s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:32 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5 Nov 06 18:41:32 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:33 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5" returned: 0 in 0.504s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:41:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95eb8d79-1010-4b8f-911c-b06f2aa9436c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d92ca302-012b-43c1-bc08-00bb41ff67d5', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93189a3e-7a5e-47e0-8f31-0fe807241b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:33 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ganr1my0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 18:41:33 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Image download 20.69 MB at 20.69 MB/s Nov 06 18:41:33 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Volume volume-d92ca302-012b-43c1-bc08-00bb41ff67d5 (d92ca302-012b-43c1-bc08-00bb41ff67d5): created successfully Nov 06 18:41:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93189a3e-7a5e-47e0-8f31-0fe807241b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Flow 'volume_create_manager' (4c7331da-5f40-4ee8-9be5-a42f82af5ada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:41:33 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-4bb032ba-d104-4986-9457-5feb661d087f req-7f62f553-4966-4177-8859-ecbcccbc6419 tempest-VolumesSnapshotsTestJSON-2028376028 None] Created volume successfully. Nov 06 18:41:33 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[3789ec5f-fd08-4db4-be1f-5c278e9cd65f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ganr1my0devstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:33 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ganr1my0devstack@QuobyteHD Nov 06 18:41:33 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:33 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ganr1my0devstack@QuobyteHD" returned: 0 in 0.413s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:33 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Temporary image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 is fetched for user bbfe13c737e24bbdabc6517400b23d41. {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 18:41:33 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2420f7c-3d35-4028-85b5-bd13afbe2703]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ganr1my0devstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:34 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ganr1my0devstack@QuobyteHD Nov 06 18:41:34 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-e65d2d8b-21d8-41b7-8011-c7c87f0fd604 req-1373f3f7-8852-40d8-bad2-c3d0b99bd058 tempest-VolumesSnapshotsTestJSON-2028376028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-e65d2d8b-21d8-41b7-8011-c7c87f0fd604 req-1373f3f7-8852-40d8-bad2-c3d0b99bd058 tempest-VolumesSnapshotsTestJSON-2028376028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [req-e65d2d8b-21d8-41b7-8011-c7c87f0fd604 req-1373f3f7-8852-40d8-bad2-c3d0b99bd058 tempest-VolumesSnapshotsTestJSON-2028376028 None] Creating offline snapshot 2d31e63e-2046-4db4-b91a-2491f02c79ae of volume d92ca302-012b-43c1-bc08-00bb41ff67d5 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:41:34 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cef7152-848b-4b75-8c66-14b824f5b91c]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-e65d2d8b-21d8-41b7-8011-c7c87f0fd604 req-1373f3f7-8852-40d8-bad2-c3d0b99bd058 tempest-VolumesSnapshotsTestJSON-2028376028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:34 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ganr1my0devstack@QuobyteHD" returned: 0 in 0.630s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:34 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5 Nov 06 18:41:34 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:34 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-e65d2d8b-21d8-41b7-8011-c7c87f0fd604 req-1373f3f7-8852-40d8-bad2-c3d0b99bd058 tempest-VolumesSnapshotsTestJSON-2028376028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5" returned: 0 in 0.426s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-e65d2d8b-21d8-41b7-8011-c7c87f0fd604 req-1373f3f7-8852-40d8-bad2-c3d0b99bd058 tempest-VolumesSnapshotsTestJSON-2028376028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.2d31e63e-2046-4db4-b91a-2491f02c79ae 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:34 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.2d31e63e-2046-4db4-b91a-2491f02c79ae 1G Nov 06 18:41:34 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:35 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-e65d2d8b-21d8-41b7-8011-c7c87f0fd604 req-1373f3f7-8852-40d8-bad2-c3d0b99bd058 tempest-VolumesSnapshotsTestJSON-2028376028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.2d31e63e-2046-4db4-b91a-2491f02c79ae 1G" returned: 0 in 0.508s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-e65d2d8b-21d8-41b7-8011-c7c87f0fd604 req-1373f3f7-8852-40d8-bad2-c3d0b99bd058 tempest-VolumesSnapshotsTestJSON-2028376028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d92ca302-012b-43c1-bc08-00bb41ff67d5 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.2d31e63e-2046-4db4-b91a-2491f02c79ae {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:35 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d92ca302-012b-43c1-bc08-00bb41ff67d5 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.2d31e63e-2046-4db4-b91a-2491f02c79ae Nov 06 18:41:35 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:35 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-e65d2d8b-21d8-41b7-8011-c7c87f0fd604 req-1373f3f7-8852-40d8-bad2-c3d0b99bd058 tempest-VolumesSnapshotsTestJSON-2028376028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d92ca302-012b-43c1-bc08-00bb41ff67d5 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.2d31e63e-2046-4db4-b91a-2491f02c79ae" returned: 0 in 0.434s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:35 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [req-e65d2d8b-21d8-41b7-8011-c7c87f0fd604 req-1373f3f7-8852-40d8-bad2-c3d0b99bd058 tempest-VolumesSnapshotsTestJSON-2028376028 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.2d31e63e-2046-4db4-b91a-2491f02c79ae is being set with open permissions: ugo+rw Nov 06 18:41:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-e65d2d8b-21d8-41b7-8011-c7c87f0fd604 req-1373f3f7-8852-40d8-bad2-c3d0b99bd058 tempest-VolumesSnapshotsTestJSON-2028376028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.2d31e63e-2046-4db4-b91a-2491f02c79ae {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:35 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.2d31e63e-2046-4db4-b91a-2491f02c79ae Nov 06 18:41:35 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:36 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-e65d2d8b-21d8-41b7-8011-c7c87f0fd604 req-1373f3f7-8852-40d8-bad2-c3d0b99bd058 tempest-VolumesSnapshotsTestJSON-2028376028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.2d31e63e-2046-4db4-b91a-2491f02c79ae" returned: 0 in 0.284s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-e65d2d8b-21d8-41b7-8011-c7c87f0fd604 req-1373f3f7-8852-40d8-bad2-c3d0b99bd058 tempest-VolumesSnapshotsTestJSON-2028376028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:36 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.info Nov 06 18:41:36 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:36 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-e65d2d8b-21d8-41b7-8011-c7c87f0fd604 req-1373f3f7-8852-40d8-bad2-c3d0b99bd058 tempest-VolumesSnapshotsTestJSON-2028376028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.info" returned: 0 in 0.300s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:36 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [req-e65d2d8b-21d8-41b7-8011-c7c87f0fd604 req-1373f3f7-8852-40d8-bad2-c3d0b99bd058 tempest-VolumesSnapshotsTestJSON-2028376028 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.info is being set with open permissions: ugo+rw Nov 06 18:41:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-e65d2d8b-21d8-41b7-8011-c7c87f0fd604 req-1373f3f7-8852-40d8-bad2-c3d0b99bd058 tempest-VolumesSnapshotsTestJSON-2028376028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:36 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.info Nov 06 18:41:36 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:36 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-e65d2d8b-21d8-41b7-8011-c7c87f0fd604 req-1373f3f7-8852-40d8-bad2-c3d0b99bd058 tempest-VolumesSnapshotsTestJSON-2028376028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.info" returned: 0 in 0.298s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-e65d2d8b-21d8-41b7-8011-c7c87f0fd604 req-1373f3f7-8852-40d8-bad2-c3d0b99bd058 tempest-VolumesSnapshotsTestJSON-2028376028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.433s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.240s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-240027414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02946bc0-8447-46b3-8c91-2c860563e003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a01be1e48249178df2f8289235a1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:41:32Z,use_quota=True,user_id='bbfe13c737e24bbdabc6517400b23d41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:41:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Creating volume 02946bc0-8447-46b3-8c91-2c860563e003 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:41:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:41:36 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:41:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-02946bc0-8447-46b3-8c91-2c860563e003 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:36 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-02946bc0-8447-46b3-8c91-2c860563e003 1073741824 Nov 06 18:41:36 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:36 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-e65d2d8b-21d8-41b7-8011-c7c87f0fd604 req-1373f3f7-8852-40d8-bad2-c3d0b99bd058 tempest-VolumesSnapshotsTestJSON-2028376028 None] Create snapshot completed successfully Nov 06 18:41:37 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-02946bc0-8447-46b3-8c91-2c860563e003 1073741824" returned: 0 in 0.631s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-02946bc0-8447-46b3-8c91-2c860563e003 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:37 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-02946bc0-8447-46b3-8c91-2c860563e003 Nov 06 18:41:37 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:37 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-02946bc0-8447-46b3-8c91-2c860563e003" returned: 0 in 0.279s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:41:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:37 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Attempting download of 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}])) to volume 02946bc0-8447-46b3-8c91-2c860563e003. {{(pid=86794) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 18:41:37 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3ef099-fa8d-4087-a0d6-0664c0f664cc]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_lx43kp2z {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] Acquiring lock "cinder-2d31e63e-2046-4db4-b91a-2491f02c79ae-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:38 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_lx43kp2z Nov 06 18:41:38 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] Lock "cinder-2d31e63e-2046-4db4-b91a-2491f02c79ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] Acquiring lock "cinder-quobyte-d92ca302-012b-43c1-bc08-00bb41ff67d5" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] Lock "cinder-quobyte-d92ca302-012b-43c1-bc08-00bb41ff67d5" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] Acquiring lock "cinder-quobyte-2d31e63e-2046-4db4-b91a-2491f02c79ae" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] Lock "cinder-quobyte-2d31e63e-2046-4db4-b91a-2491f02c79ae" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] Deleting offline snapshot 2d31e63e-2046-4db4-b91a-2491f02c79ae of volume d92ca302-012b-43c1-bc08-00bb41ff67d5 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:41:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] snapshot_file for this snap is: volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.2d31e63e-2046-4db4-b91a-2491f02c79ae {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:41:38 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb557e72-46a6-46d4-9dc7-ce0944600347]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.2d31e63e-2046-4db4-b91a-2491f02c79ae {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:38 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.2d31e63e-2046-4db4-b91a-2491f02c79ae Nov 06 18:41:38 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:38 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_lx43kp2z" returned: 0 in 0.535s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_lx43kp2z {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:38 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_lx43kp2z Nov 06 18:41:38 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:38 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.2d31e63e-2046-4db4-b91a-2491f02c79ae" returned: 0 in 0.497s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d92ca302-012b-43c1-bc08-00bb41ff67d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:41:38 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca8344c-80f4-4fa7-ad15-6337373fbf5d]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:38 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_lx43kp2z" returned: 1 in 0.448s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_lx43kp2z' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:41:38 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c67ffe-245d-4b0a-aac2-0f43d3007288]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ganr1my0devstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:38 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5 Nov 06 18:41:38 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:39 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ganr1my0devstack@QuobyteHD Nov 06 18:41:39 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:39 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5" returned: 0 in 0.571s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.2d31e63e-2046-4db4-b91a-2491f02c79ae {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:39 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.2d31e63e-2046-4db4-b91a-2491f02c79ae Nov 06 18:41:39 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:39 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ganr1my0devstack@QuobyteHD" returned: 0 in 0.515s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:39 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 was qcow2, converting to qcow2 {{(pid=86794) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 18:41:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ganr1my0devstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-02946bc0-8447-46b3-8c91-2c860563e003 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:39 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ganr1my0devstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-02946bc0-8447-46b3-8c91-2c860563e003 Nov 06 18:41:39 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c99d34e0-54c4-49a6-9129-5ed5cc011962 tempest-AttachVolumeNegativeTest-672322174 None] Acquiring lock "cinder-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c99d34e0-54c4-49a6-9129-5ed5cc011962 tempest-AttachVolumeNegativeTest-672322174 None] Lock "cinder-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:39 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.2d31e63e-2046-4db4-b91a-2491f02c79ae" returned: 0 in 0.507s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.2d31e63e-2046-4db4-b91a-2491f02c79ae {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:39 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.2d31e63e-2046-4db4-b91a-2491f02c79ae Nov 06 18:41:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c99d34e0-54c4-49a6-9129-5ed5cc011962 tempest-AttachVolumeNegativeTest-672322174 None] Acquiring lock "cinder-quobyte-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:39 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c99d34e0-54c4-49a6-9129-5ed5cc011962 tempest-AttachVolumeNegativeTest-672322174 None] Lock "cinder-quobyte-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6" acquired by "delete_volume" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:39 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a67756-be1f-41cc-bc4b-2bf1e6368ca8]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c99d34e0-54c4-49a6-9129-5ed5cc011962 tempest-AttachVolumeNegativeTest-672322174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:40 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6 Nov 06 18:41:40 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:40 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5.2d31e63e-2046-4db4-b91a-2491f02c79ae" returned: 0 in 0.347s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] Lock "cinder-quobyte-2d31e63e-2046-4db4-b91a-2491f02c79ae" released by "_delete_snapshot" :: held 2.125s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] Lock "cinder-quobyte-d92ca302-012b-43c1-bc08-00bb41ff67d5" released by "delete_snapshot" :: held 2.164s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:40 devstack cinder-volume[86794]: DEBUG cinder.quota [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] Created reservations ['5d9e99e3-36d1-45cf-b3f0-3e0bc4983c7d', 'cc44a6eb-6180-4582-9e0b-dd3cd74e03de', '6076e98e-4210-4db8-a3ae-b88174ac05f6', '99a3a74b-44e2-45b5-9cde-99c5b27e36b8'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:41:40 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] Delete snapshot completed successfully. Nov 06 18:41:40 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-edac488c-d916-4fa9-a0ab-91cd7cefb031 req-6aa0b40f-c0d3-4a33-bd43-08497d77d9d4 tempest-VolumesSnapshotsTestJSON-2028376028 None] Lock "cinder-2d31e63e-2046-4db4-b91a-2491f02c79ae-delete_snapshot" released by "delete_snapshot" :: held 2.382s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c99d34e0-54c4-49a6-9129-5ed5cc011962 tempest-AttachVolumeNegativeTest-672322174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6" returned: 0 in 0.535s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c99d34e0-54c4-49a6-9129-5ed5cc011962 tempest-AttachVolumeNegativeTest-672322174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:40 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6 Nov 06 18:41:40 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:40 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c99d34e0-54c4-49a6-9129-5ed5cc011962 tempest-AttachVolumeNegativeTest-672322174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6" returned: 0 in 0.334s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c99d34e0-54c4-49a6-9129-5ed5cc011962 tempest-AttachVolumeNegativeTest-672322174 None] Lock "cinder-quobyte-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6" released by "delete_volume" :: held 0.922s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:40 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-c99d34e0-54c4-49a6-9129-5ed5cc011962 tempest-AttachVolumeNegativeTest-672322174 None] Created reservations ['dc392526-a9ec-487e-b636-b1de3f4f2d18', 'ba4ea633-204b-4028-afe5-f8b33c864883', 'c95a4fa8-21ef-4969-9c1e-e8d071b34019', 'af816c92-ec2f-4a37-b030-a2e064d7747d'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:41:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c99d34e0-54c4-49a6-9129-5ed5cc011962 tempest-AttachVolumeNegativeTest-672322174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c99d34e0-54c4-49a6-9129-5ed5cc011962 tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c99d34e0-54c4-49a6-9129-5ed5cc011962 tempest-AttachVolumeNegativeTest-672322174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c99d34e0-54c4-49a6-9129-5ed5cc011962 tempest-AttachVolumeNegativeTest-672322174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c99d34e0-54c4-49a6-9129-5ed5cc011962 tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c99d34e0-54c4-49a6-9129-5ed5cc011962 tempest-AttachVolumeNegativeTest-672322174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:40 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:41:40 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:41 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c99d34e0-54c4-49a6-9129-5ed5cc011962 tempest-AttachVolumeNegativeTest-672322174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.279s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:41 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-c99d34e0-54c4-49a6-9129-5ed5cc011962 tempest-AttachVolumeNegativeTest-672322174 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:41:41 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c99d34e0-54c4-49a6-9129-5ed5cc011962 tempest-AttachVolumeNegativeTest-672322174 None] Deleted volume successfully. Nov 06 18:41:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c99d34e0-54c4-49a6-9129-5ed5cc011962 tempest-AttachVolumeNegativeTest-672322174 None] Lock "cinder-0d83d8c4-ea8e-49ee-83fc-d437f4f4dac6-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-96c52ed7-9243-4bab-8cc1-0b251e2ee94a req-8fddcb77-decf-4972-be9d-7c903c03baca tempest-VolumesSnapshotsTestJSON-2028376028 None] Acquiring lock "cinder-d92ca302-012b-43c1-bc08-00bb41ff67d5-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-96c52ed7-9243-4bab-8cc1-0b251e2ee94a req-8fddcb77-decf-4972-be9d-7c903c03baca tempest-VolumesSnapshotsTestJSON-2028376028 None] Lock "cinder-d92ca302-012b-43c1-bc08-00bb41ff67d5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-96c52ed7-9243-4bab-8cc1-0b251e2ee94a req-8fddcb77-decf-4972-be9d-7c903c03baca tempest-VolumesSnapshotsTestJSON-2028376028 None] Acquiring lock "cinder-quobyte-d92ca302-012b-43c1-bc08-00bb41ff67d5" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-96c52ed7-9243-4bab-8cc1-0b251e2ee94a req-8fddcb77-decf-4972-be9d-7c903c03baca tempest-VolumesSnapshotsTestJSON-2028376028 None] Lock "cinder-quobyte-d92ca302-012b-43c1-bc08-00bb41ff67d5" acquired by "delete_volume" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:41 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[57938d14-ded9-4727-bdd9-797b74894cff]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-96c52ed7-9243-4bab-8cc1-0b251e2ee94a req-8fddcb77-decf-4972-be9d-7c903c03baca tempest-VolumesSnapshotsTestJSON-2028376028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:41 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ganr1my0devstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-02946bc0-8447-46b3-8c91-2c860563e003" returned: 0 in 2.305s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:41 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ganr1my0devstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-02946bc0-8447-46b3-8c91-2c860563e003 {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:41:41 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Converted 112.00 MB image at 48.56 MB/s Nov 06 18:41:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-02946bc0-8447-46b3-8c91-2c860563e003 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:41 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5 Nov 06 18:41:41 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:41 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-02946bc0-8447-46b3-8c91-2c860563e003 1G Nov 06 18:41:41 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:42 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-96c52ed7-9243-4bab-8cc1-0b251e2ee94a req-8fddcb77-decf-4972-be9d-7c903c03baca tempest-VolumesSnapshotsTestJSON-2028376028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5" returned: 0 in 0.415s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-96c52ed7-9243-4bab-8cc1-0b251e2ee94a req-8fddcb77-decf-4972-be9d-7c903c03baca tempest-VolumesSnapshotsTestJSON-2028376028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:42 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5 Nov 06 18:41:42 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:42 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-02946bc0-8447-46b3-8c91-2c860563e003 1G" returned: 0 in 0.417s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Downloaded image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}])) to volume 02946bc0-8447-46b3-8c91-2c860563e003 successfully. {{(pid=86794) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Temporary image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 for user bbfe13c737e24bbdabc6517400b23d41 is deleted. {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Marking volume 02946bc0-8447-46b3-8c91-2c860563e003 as bootable. {{(pid=86794) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1d36c723-106d-4e06-aa9d-8a80cdbe3036 tempest-AttachVolumeNegativeTest-672322174 None] Acquiring lock "cinder-842d3f09-6475-4c19-8f5f-8f60d5076500-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Copying metadata from image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 to 02946bc0-8447-46b3-8c91-2c860563e003. {{(pid=86794) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Creating volume glance metadata for volume 02946bc0-8447-46b3-8c91-2c860563e003 backed by image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86794) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1d36c723-106d-4e06-aa9d-8a80cdbe3036 tempest-AttachVolumeNegativeTest-672322174 None] Lock "cinder-842d3f09-6475-4c19-8f5f-8f60d5076500-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1d36c723-106d-4e06-aa9d-8a80cdbe3036 tempest-AttachVolumeNegativeTest-672322174 None] Acquiring lock "cinder-quobyte-842d3f09-6475-4c19-8f5f-8f60d5076500" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1d36c723-106d-4e06-aa9d-8a80cdbe3036 tempest-AttachVolumeNegativeTest-672322174 None] Lock "cinder-quobyte-842d3f09-6475-4c19-8f5f-8f60d5076500" acquired by "delete_volume" :: waited 0.023s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:42 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-96c52ed7-9243-4bab-8cc1-0b251e2ee94a req-8fddcb77-decf-4972-be9d-7c903c03baca tempest-VolumesSnapshotsTestJSON-2028376028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d92ca302-012b-43c1-bc08-00bb41ff67d5" returned: 0 in 0.291s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[c564212a-316f-497e-9e34-d2ef63560fb0]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1d36c723-106d-4e06-aa9d-8a80cdbe3036 tempest-AttachVolumeNegativeTest-672322174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-842d3f09-6475-4c19-8f5f-8f60d5076500 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-96c52ed7-9243-4bab-8cc1-0b251e2ee94a req-8fddcb77-decf-4972-be9d-7c903c03baca tempest-VolumesSnapshotsTestJSON-2028376028 None] Lock "cinder-quobyte-d92ca302-012b-43c1-bc08-00bb41ff67d5" released by "delete_volume" :: held 0.815s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95f8c12-08e3-423e-9a75-aadcad0e2342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02946bc0-8447-46b3-8c91-2c860563e003', 'volume_size': 1, 'image_id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d57c6da8e464b1a80cefabe6e3cfecd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'created_at': datetime.datetime(2026, 11, 6, 17, 27, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 27, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e000c8b3-5d80-466b-bcc6-b1887d33afff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:42 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Volume volume-02946bc0-8447-46b3-8c91-2c860563e003 (02946bc0-8447-46b3-8c91-2c860563e003): created successfully Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e000c8b3-5d80-466b-bcc6-b1887d33afff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Flow 'volume_create_manager' (aac488d4-309d-4e57-a884-a8d3d5b72b52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:41:42 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-7586feeb-3e03-4a90-ab16-8a2ff4cdff71 tempest-VolumesImageMetadata-415934996 None] Created volume successfully. Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG cinder.quota [req-96c52ed7-9243-4bab-8cc1-0b251e2ee94a req-8fddcb77-decf-4972-be9d-7c903c03baca tempest-VolumesSnapshotsTestJSON-2028376028 None] Created reservations ['73c97ce5-a3a9-4765-9e96-1a538f1bc2e8', '81765695-7cfb-4c0d-8a39-00df3d9fb6b4', '4f2de7e5-90da-4b75-996d-9f3fd9134b7c', '3542750e-c485-4e7b-b397-03f340cb3cfe'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:41:42 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-842d3f09-6475-4c19-8f5f-8f60d5076500 Nov 06 18:41:42 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-96c52ed7-9243-4bab-8cc1-0b251e2ee94a req-8fddcb77-decf-4972-be9d-7c903c03baca tempest-VolumesSnapshotsTestJSON-2028376028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-96c52ed7-9243-4bab-8cc1-0b251e2ee94a req-8fddcb77-decf-4972-be9d-7c903c03baca tempest-VolumesSnapshotsTestJSON-2028376028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [req-96c52ed7-9243-4bab-8cc1-0b251e2ee94a req-8fddcb77-decf-4972-be9d-7c903c03baca tempest-VolumesSnapshotsTestJSON-2028376028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [req-96c52ed7-9243-4bab-8cc1-0b251e2ee94a req-8fddcb77-decf-4972-be9d-7c903c03baca tempest-VolumesSnapshotsTestJSON-2028376028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-96c52ed7-9243-4bab-8cc1-0b251e2ee94a req-8fddcb77-decf-4972-be9d-7c903c03baca tempest-VolumesSnapshotsTestJSON-2028376028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-96c52ed7-9243-4bab-8cc1-0b251e2ee94a req-8fddcb77-decf-4972-be9d-7c903c03baca tempest-VolumesSnapshotsTestJSON-2028376028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:42 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:41:42 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:42 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:42 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-96c52ed7-9243-4bab-8cc1-0b251e2ee94a req-8fddcb77-decf-4972-be9d-7c903c03baca tempest-VolumesSnapshotsTestJSON-2028376028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.437s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG cinder.manager [req-96c52ed7-9243-4bab-8cc1-0b251e2ee94a req-8fddcb77-decf-4972-be9d-7c903c03baca tempest-VolumesSnapshotsTestJSON-2028376028 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1d36c723-106d-4e06-aa9d-8a80cdbe3036 tempest-AttachVolumeNegativeTest-672322174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-842d3f09-6475-4c19-8f5f-8f60d5076500" returned: 0 in 0.636s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1d36c723-106d-4e06-aa9d-8a80cdbe3036 tempest-AttachVolumeNegativeTest-672322174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-842d3f09-6475-4c19-8f5f-8f60d5076500 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:43 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-96c52ed7-9243-4bab-8cc1-0b251e2ee94a req-8fddcb77-decf-4972-be9d-7c903c03baca tempest-VolumesSnapshotsTestJSON-2028376028 None] Deleted volume successfully. Nov 06 18:41:43 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-842d3f09-6475-4c19-8f5f-8f60d5076500 Nov 06 18:41:43 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-96c52ed7-9243-4bab-8cc1-0b251e2ee94a req-8fddcb77-decf-4972-be9d-7c903c03baca tempest-VolumesSnapshotsTestJSON-2028376028 None] Lock "cinder-d92ca302-012b-43c1-bc08-00bb41ff67d5-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:43 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1d36c723-106d-4e06-aa9d-8a80cdbe3036 tempest-AttachVolumeNegativeTest-672322174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-842d3f09-6475-4c19-8f5f-8f60d5076500" returned: 0 in 0.431s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1d36c723-106d-4e06-aa9d-8a80cdbe3036 tempest-AttachVolumeNegativeTest-672322174 None] Lock "cinder-quobyte-842d3f09-6475-4c19-8f5f-8f60d5076500" released by "delete_volume" :: held 1.144s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:43 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-1d36c723-106d-4e06-aa9d-8a80cdbe3036 tempest-AttachVolumeNegativeTest-672322174 None] Created reservations ['f68e35f2-7def-44e8-8d93-34c5dbef9e5e', 'bc202638-66b8-499d-ae64-e2d4d0743c25', '463691e2-aa95-4eb0-b92b-de34c5484e4b', 'f977fae3-9831-43c9-95c9-b1e8d38b79e1'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:41:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1d36c723-106d-4e06-aa9d-8a80cdbe3036 tempest-AttachVolumeNegativeTest-672322174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1d36c723-106d-4e06-aa9d-8a80cdbe3036 tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:43 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1d36c723-106d-4e06-aa9d-8a80cdbe3036 tempest-AttachVolumeNegativeTest-672322174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:43 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1d36c723-106d-4e06-aa9d-8a80cdbe3036 tempest-AttachVolumeNegativeTest-672322174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1d36c723-106d-4e06-aa9d-8a80cdbe3036 tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1d36c723-106d-4e06-aa9d-8a80cdbe3036 tempest-AttachVolumeNegativeTest-672322174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:43 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:41:43 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5bdf9463-2131-4f9c-839f-865095120f99 tempest-VolumesImageMetadata-415934996 None] Acquiring lock "cinder-02946bc0-8447-46b3-8c91-2c860563e003-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5bdf9463-2131-4f9c-839f-865095120f99 tempest-VolumesImageMetadata-415934996 None] Lock "cinder-02946bc0-8447-46b3-8c91-2c860563e003-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5bdf9463-2131-4f9c-839f-865095120f99 tempest-VolumesImageMetadata-415934996 None] Acquiring lock "cinder-quobyte-02946bc0-8447-46b3-8c91-2c860563e003" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5bdf9463-2131-4f9c-839f-865095120f99 tempest-VolumesImageMetadata-415934996 None] Lock "cinder-quobyte-02946bc0-8447-46b3-8c91-2c860563e003" acquired by "delete_volume" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:43 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[6beb98d1-ea66-40fb-8dd7-304c8ef26f12]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5bdf9463-2131-4f9c-839f-865095120f99 tempest-VolumesImageMetadata-415934996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-02946bc0-8447-46b3-8c91-2c860563e003 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:43 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1d36c723-106d-4e06-aa9d-8a80cdbe3036 tempest-AttachVolumeNegativeTest-672322174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.300s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:43 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-1d36c723-106d-4e06-aa9d-8a80cdbe3036 tempest-AttachVolumeNegativeTest-672322174 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:41:43 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-1d36c723-106d-4e06-aa9d-8a80cdbe3036 tempest-AttachVolumeNegativeTest-672322174 None] Deleted volume successfully. Nov 06 18:41:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1d36c723-106d-4e06-aa9d-8a80cdbe3036 tempest-AttachVolumeNegativeTest-672322174 None] Lock "cinder-842d3f09-6475-4c19-8f5f-8f60d5076500-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:44 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-02946bc0-8447-46b3-8c91-2c860563e003 Nov 06 18:41:44 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:44 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5bdf9463-2131-4f9c-839f-865095120f99 tempest-VolumesImageMetadata-415934996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-02946bc0-8447-46b3-8c91-2c860563e003" returned: 0 in 0.436s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5bdf9463-2131-4f9c-839f-865095120f99 tempest-VolumesImageMetadata-415934996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-02946bc0-8447-46b3-8c91-2c860563e003 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:44 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-02946bc0-8447-46b3-8c91-2c860563e003 Nov 06 18:41:44 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:44 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5bdf9463-2131-4f9c-839f-865095120f99 tempest-VolumesImageMetadata-415934996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-02946bc0-8447-46b3-8c91-2c860563e003" returned: 0 in 0.425s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5bdf9463-2131-4f9c-839f-865095120f99 tempest-VolumesImageMetadata-415934996 None] Lock "cinder-quobyte-02946bc0-8447-46b3-8c91-2c860563e003" released by "delete_volume" :: held 0.922s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-cfd87ade-e91a-4423-be8f-e0d449f6c2bc tempest-AttachVolumeNegativeTest-672322174 None] Acquiring lock "cinder-39dbe0b6-436f-4647-934d-9ec905586e53-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:44 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-5bdf9463-2131-4f9c-839f-865095120f99 tempest-VolumesImageMetadata-415934996 None] Created reservations ['70428f76-270d-4ab7-bb03-e95304c8c54a', '9bf0803d-3cbb-4004-aef9-ebc2c362d118', 'f3d439bb-e001-4782-acf0-5d5855363975', 'b80a8f68-cc67-463d-8c7b-5e70fa742285'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:41:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-cfd87ade-e91a-4423-be8f-e0d449f6c2bc tempest-AttachVolumeNegativeTest-672322174 None] Lock "cinder-39dbe0b6-436f-4647-934d-9ec905586e53-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-cfd87ade-e91a-4423-be8f-e0d449f6c2bc tempest-AttachVolumeNegativeTest-672322174 None] Acquiring lock "cinder-quobyte-39dbe0b6-436f-4647-934d-9ec905586e53" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:41:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-cfd87ade-e91a-4423-be8f-e0d449f6c2bc tempest-AttachVolumeNegativeTest-672322174 None] Lock "cinder-quobyte-39dbe0b6-436f-4647-934d-9ec905586e53" acquired by "delete_volume" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:41:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5bdf9463-2131-4f9c-839f-865095120f99 tempest-VolumesImageMetadata-415934996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5bdf9463-2131-4f9c-839f-865095120f99 tempest-VolumesImageMetadata-415934996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:45 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5bdf9463-2131-4f9c-839f-865095120f99 tempest-VolumesImageMetadata-415934996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:45 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5bdf9463-2131-4f9c-839f-865095120f99 tempest-VolumesImageMetadata-415934996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5bdf9463-2131-4f9c-839f-865095120f99 tempest-VolumesImageMetadata-415934996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5bdf9463-2131-4f9c-839f-865095120f99 tempest-VolumesImageMetadata-415934996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:45 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e703584-9252-4a4a-9b68-f8beb411e033]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:41:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cfd87ade-e91a-4423-be8f-e0d449f6c2bc tempest-AttachVolumeNegativeTest-672322174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-39dbe0b6-436f-4647-934d-9ec905586e53 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:45 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:41:45 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:45 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-39dbe0b6-436f-4647-934d-9ec905586e53 Nov 06 18:41:45 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:45 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5bdf9463-2131-4f9c-839f-865095120f99 tempest-VolumesImageMetadata-415934996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.376s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:45 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-5bdf9463-2131-4f9c-839f-865095120f99 tempest-VolumesImageMetadata-415934996 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:41:45 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-5bdf9463-2131-4f9c-839f-865095120f99 tempest-VolumesImageMetadata-415934996 None] Deleted volume successfully. Nov 06 18:41:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5bdf9463-2131-4f9c-839f-865095120f99 tempest-VolumesImageMetadata-415934996 None] Lock "cinder-02946bc0-8447-46b3-8c91-2c860563e003-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:45 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cfd87ade-e91a-4423-be8f-e0d449f6c2bc tempest-AttachVolumeNegativeTest-672322174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-39dbe0b6-436f-4647-934d-9ec905586e53" returned: 0 in 0.504s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cfd87ade-e91a-4423-be8f-e0d449f6c2bc tempest-AttachVolumeNegativeTest-672322174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-39dbe0b6-436f-4647-934d-9ec905586e53 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:45 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-39dbe0b6-436f-4647-934d-9ec905586e53 Nov 06 18:41:45 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:45 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cfd87ade-e91a-4423-be8f-e0d449f6c2bc tempest-AttachVolumeNegativeTest-672322174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-39dbe0b6-436f-4647-934d-9ec905586e53" returned: 0 in 0.291s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-cfd87ade-e91a-4423-be8f-e0d449f6c2bc tempest-AttachVolumeNegativeTest-672322174 None] Lock "cinder-quobyte-39dbe0b6-436f-4647-934d-9ec905586e53" released by "delete_volume" :: held 0.885s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:45 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-cfd87ade-e91a-4423-be8f-e0d449f6c2bc tempest-AttachVolumeNegativeTest-672322174 None] Created reservations ['26f8fd70-ca9f-4f39-91c1-652dc628c6b4', '84f01de3-2241-429f-a495-dbf63d729c7f', '2bd88ff1-0808-4cd8-b693-94c89b719b8d', '379d0b03-202a-443d-b7ee-d9d669836631'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:41:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cfd87ade-e91a-4423-be8f-e0d449f6c2bc tempest-AttachVolumeNegativeTest-672322174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cfd87ade-e91a-4423-be8f-e0d449f6c2bc tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cfd87ade-e91a-4423-be8f-e0d449f6c2bc tempest-AttachVolumeNegativeTest-672322174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cfd87ade-e91a-4423-be8f-e0d449f6c2bc tempest-AttachVolumeNegativeTest-672322174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cfd87ade-e91a-4423-be8f-e0d449f6c2bc tempest-AttachVolumeNegativeTest-672322174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cfd87ade-e91a-4423-be8f-e0d449f6c2bc tempest-AttachVolumeNegativeTest-672322174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:46 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:41:46 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:46 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cfd87ade-e91a-4423-be8f-e0d449f6c2bc tempest-AttachVolumeNegativeTest-672322174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.348s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:46 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cfd87ade-e91a-4423-be8f-e0d449f6c2bc tempest-AttachVolumeNegativeTest-672322174 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:41:46 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-cfd87ade-e91a-4423-be8f-e0d449f6c2bc tempest-AttachVolumeNegativeTest-672322174 None] Deleted volume successfully. Nov 06 18:41:46 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-cfd87ade-e91a-4423-be8f-e0d449f6c2bc tempest-AttachVolumeNegativeTest-672322174 None] Lock "cinder-39dbe0b6-436f-4647-934d-9ec905586e53-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:41:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf7ac1cc-731f-41b0-ba28-4d0cf68b8aeb tempest-BackendsCapabilitiesAdminTestsJSON-325836961 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7579803466797, 'free_capacity_gb': 1773.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86794) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 18:41:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f6f0310a-26c0-4ae6-b271-39656b7a2c9a tempest-BackendsCapabilitiesAdminTestsJSON-325836961 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7579803466797, 'free_capacity_gb': 1773.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86794) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 18:41:56 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=62,cinder:UPDATE=53,cinder:DELETE=2,cinder:INSERT=22 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:41:56 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:UPDATE=59,cinder:SELECT=42,cinder:INSERT=18,cinder:DELETE=6 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:41:58 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-08f62c0e-ed18-4e0a-9fb6-e79383336fe5 tempest-GroupSnapshotsV319Test-1952113249 None] Group tempest-GroupSnapshotsV319Test-Group-1830086843: creating Nov 06 18:41:58 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-08f62c0e-ed18-4e0a-9fb6-e79383336fe5 tempest-GroupSnapshotsV319Test-1952113249 None] Group tempest-GroupSnapshotsV319Test-Group-1830086843: created successfully Nov 06 18:41:58 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-08f62c0e-ed18-4e0a-9fb6-e79383336fe5 tempest-GroupSnapshotsV319Test-1952113249 None] Create group completed successfully. Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Flow 'volume_create_manager' (b14ea6a4-9a87-42a7-b018-c08db59a74bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e54ddd02-45ef-4334-8e39-b13d29f70fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e54ddd02-45ef-4334-8e39-b13d29f70fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-791914770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555ce4ab-8323-459a-831b-f01adff54f51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='852b155db5a34c93a987926f53ba0801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:41:59Z,use_quota=True,user_id='db48a3f144e846aba18c71015dae0b28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdae69a3-ae01-4fe2-82d4-68bc67fceb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdae69a3-ae01-4fe2-82d4-68bc67fceb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f04d942-f615-4a53-80f7-16ab3c7dee3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f04d942-f615-4a53-80f7-16ab3c7dee3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '555ce4ab-8323-459a-831b-f01adff54f51', 'volume_name': 'volume-555ce4ab-8323-459a-831b-f01adff54f51', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30deb9da-bd97-4f41-b240-0ad68bd8dbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30deb9da-bd97-4f41-b240-0ad68bd8dbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23b5a39-f7ca-40f2-ab39-6803fd5067e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:41:58 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Volume 555ce4ab-8323-459a-831b-f01adff54f51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-555ce4ab-8323-459a-831b-f01adff54f51', 'volume_size': 1} Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-791914770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555ce4ab-8323-459a-831b-f01adff54f51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='852b155db5a34c93a987926f53ba0801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:41:59Z,use_quota=True,user_id='db48a3f144e846aba18c71015dae0b28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Creating volume 555ce4ab-8323-459a-831b-f01adff54f51 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:41:58 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:41:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-555ce4ab-8323-459a-831b-f01adff54f51 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:58 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-555ce4ab-8323-459a-831b-f01adff54f51 1073741824 Nov 06 18:41:58 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:41:59 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Nov 06 18:41:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-555ce4ab-8323-459a-831b-f01adff54f51 1073741824" returned: 0 in 0.606s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:41:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-555ce4ab-8323-459a-831b-f01adff54f51 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:41:59 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-555ce4ab-8323-459a-831b-f01adff54f51 Nov 06 18:41:59 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:00 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-555ce4ab-8323-459a-831b-f01adff54f51" returned: 0 in 0.441s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23b5a39-f7ca-40f2-ab39-6803fd5067e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-555ce4ab-8323-459a-831b-f01adff54f51', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d134230-5e3b-49e8-953a-b898f335fad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:00 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Volume volume-555ce4ab-8323-459a-831b-f01adff54f51 (555ce4ab-8323-459a-831b-f01adff54f51): created successfully Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d134230-5e3b-49e8-953a-b898f335fad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Flow 'volume_create_manager' (b14ea6a4-9a87-42a7-b018-c08db59a74bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:00 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-5dca50ce-686a-4308-90b0-27bb68b34dd5 req-74ae9c64-eee8-41d1-91b8-3142ca506a0a tempest-VolumesGetTestJSON-1140781930 None] Created volume successfully. Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Flow 'volume_create_manager' (0db3c6b6-57e5-48a3-a0bd-58ca9fadc521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24cbe93-a1b6-4ee7-95d4-2287ed8a0990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24cbe93-a1b6-4ee7-95d4-2287ed8a0990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-481711763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ba430694-26a6-4234-8c79-fb95cf96920c,host='devstack@QuobyteHD#QuobyteHD',id=0e1a726a-dada-4aea-b654-577b32508466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fb137a1fda443fb0f7d55e499ee95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:00Z,use_quota=True,user_id='9755d09d735045c98c229dcf1d3a0289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed88b384-d9d6-44c3-85f3-c56fdf2f9445),volume_type_id=ed88b384-d9d6-44c3-85f3-c56fdf2f9445)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cca91cc-8807-4cf2-91e4-f1b2452f55a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cca91cc-8807-4cf2-91e4-f1b2452f55a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51609df4-152c-42e6-b3cb-f20157281e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51609df4-152c-42e6-b3cb-f20157281e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e1a726a-dada-4aea-b654-577b32508466', 'volume_name': 'volume-0e1a726a-dada-4aea-b654-577b32508466', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cffae34-df66-4e1a-95e7-2db67d929401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cffae34-df66-4e1a-95e7-2db67d929401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66d4c3a-c18b-429e-8d94-b63ca1ec5126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:00 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Volume 0e1a726a-dada-4aea-b654-577b32508466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e1a726a-dada-4aea-b654-577b32508466', 'volume_size': 1} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ba430694-26a6-4234-8c79-fb95cf96920c,created_at=2026-11-06T17:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-481711763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ba430694-26a6-4234-8c79-fb95cf96920c,host='devstack@QuobyteHD#QuobyteHD',id=0e1a726a-dada-4aea-b654-577b32508466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fb137a1fda443fb0f7d55e499ee95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:00Z,use_quota=True,user_id='9755d09d735045c98c229dcf1d3a0289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed88b384-d9d6-44c3-85f3-c56fdf2f9445),volume_type_id=ed88b384-d9d6-44c3-85f3-c56fdf2f9445)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Creating volume 0e1a726a-dada-4aea-b654-577b32508466 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:42:00 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:42:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:00 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466 1073741824 Nov 06 18:42:00 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:01 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466 1073741824" returned: 0 in 0.863s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:01 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466 Nov 06 18:42:01 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:01 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466" returned: 0 in 0.616s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:01 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:42:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66d4c3a-c18b-429e-8d94-b63ca1ec5126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e1a726a-dada-4aea-b654-577b32508466', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d1f9c5-44f4-444d-bbb5-43118c7a307f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:02 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Volume volume-0e1a726a-dada-4aea-b654-577b32508466 (0e1a726a-dada-4aea-b654-577b32508466): created successfully Nov 06 18:42:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d1f9c5-44f4-444d-bbb5-43118c7a307f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Flow 'volume_create_manager' (0db3c6b6-57e5-48a3-a0bd-58ca9fadc521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:02 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-45949576-fe30-43bd-a75e-2f6c453e5747 tempest-GroupSnapshotsV319Test-1952113249 None] Created volume successfully. Nov 06 18:42:02 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-69c251e4-266e-44ca-a53c-933b6e978e01 req-79703d09-f1e1-44e1-ac23-650fcfee1204 tempest-VolumesGetTestJSON-1140781930 None] Acquiring lock "cinder-555ce4ab-8323-459a-831b-f01adff54f51-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:02 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-69c251e4-266e-44ca-a53c-933b6e978e01 req-79703d09-f1e1-44e1-ac23-650fcfee1204 tempest-VolumesGetTestJSON-1140781930 None] Lock "cinder-555ce4ab-8323-459a-831b-f01adff54f51-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:02 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-69c251e4-266e-44ca-a53c-933b6e978e01 req-79703d09-f1e1-44e1-ac23-650fcfee1204 tempest-VolumesGetTestJSON-1140781930 None] Acquiring lock "cinder-quobyte-555ce4ab-8323-459a-831b-f01adff54f51" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:02 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-69c251e4-266e-44ca-a53c-933b6e978e01 req-79703d09-f1e1-44e1-ac23-650fcfee1204 tempest-VolumesGetTestJSON-1140781930 None] Lock "cinder-quobyte-555ce4ab-8323-459a-831b-f01adff54f51" acquired by "delete_volume" :: waited 0.045s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:02 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49a309f-be74-49f1-8da7-89c63fcf9c6f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-69c251e4-266e-44ca-a53c-933b6e978e01 req-79703d09-f1e1-44e1-ac23-650fcfee1204 tempest-VolumesGetTestJSON-1140781930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-555ce4ab-8323-459a-831b-f01adff54f51 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:02 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-555ce4ab-8323-459a-831b-f01adff54f51 Nov 06 18:42:02 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:02 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-69c251e4-266e-44ca-a53c-933b6e978e01 req-79703d09-f1e1-44e1-ac23-650fcfee1204 tempest-VolumesGetTestJSON-1140781930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-555ce4ab-8323-459a-831b-f01adff54f51" returned: 0 in 0.611s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-69c251e4-266e-44ca-a53c-933b6e978e01 req-79703d09-f1e1-44e1-ac23-650fcfee1204 tempest-VolumesGetTestJSON-1140781930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-555ce4ab-8323-459a-831b-f01adff54f51 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:02 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-555ce4ab-8323-459a-831b-f01adff54f51 Nov 06 18:42:02 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Flow 'volume_create_manager' (35b64497-4adf-48b8-acd0-bf8839082dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d66acb8-8a29-488f-95d4-b0cc0ab575d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d66acb8-8a29-488f-95d4-b0cc0ab575d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-568997581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ff3cfc-0777-4e9b-816e-ce47afff869a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ab7eb52d5fc4e2aa474edca88ecc75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:03Z,use_quota=True,user_id='c84a29d4958a4f3c873e2b90a3f5fe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40d6151-409a-4e7d-aa81-d2918c3a10be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40d6151-409a-4e7d-aa81-d2918c3a10be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b3d496-8829-4424-a337-a84a6ea5950b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b3d496-8829-4424-a337-a84a6ea5950b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7ff3cfc-0777-4e9b-816e-ce47afff869a', 'volume_name': 'volume-b7ff3cfc-0777-4e9b-816e-ce47afff869a', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac9cd5e-6566-4898-b018-4795b6bc5511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac9cd5e-6566-4898-b018-4795b6bc5511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c79aad8-42ce-4ff8-967b-fa91a3a6043b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:03 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Volume b7ff3cfc-0777-4e9b-816e-ce47afff869a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7ff3cfc-0777-4e9b-816e-ce47afff869a', 'volume_size': 1} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-568997581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ff3cfc-0777-4e9b-816e-ce47afff869a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ab7eb52d5fc4e2aa474edca88ecc75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:03Z,use_quota=True,user_id='c84a29d4958a4f3c873e2b90a3f5fe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Creating volume b7ff3cfc-0777-4e9b-816e-ce47afff869a {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:42:03 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b7ff3cfc-0777-4e9b-816e-ce47afff869a 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:03 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b7ff3cfc-0777-4e9b-816e-ce47afff869a 1073741824 Nov 06 18:42:03 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:03 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] GroupSnapshot b82fc385-a80d-4461-bb13-2ee308b5b033: creating. Nov 06 18:42:03 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-69c251e4-266e-44ca-a53c-933b6e978e01 req-79703d09-f1e1-44e1-ac23-650fcfee1204 tempest-VolumesGetTestJSON-1140781930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-555ce4ab-8323-459a-831b-f01adff54f51" returned: 0 in 0.361s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] Group snapshot b82fc385-a80d-4461-bb13-2ee308b5b033: creating. {{(pid=86794) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-69c251e4-266e-44ca-a53c-933b6e978e01 req-79703d09-f1e1-44e1-ac23-650fcfee1204 tempest-VolumesGetTestJSON-1140781930 None] Lock "cinder-quobyte-555ce4ab-8323-459a-831b-f01adff54f51" released by "delete_volume" :: held 1.057s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.quota [req-69c251e4-266e-44ca-a53c-933b6e978e01 req-79703d09-f1e1-44e1-ac23-650fcfee1204 tempest-VolumesGetTestJSON-1140781930 None] Created reservations ['8b8d46a0-b8b3-49a5-bbdb-5eef8a940a04', '91ac5a3d-dfeb-4a5f-a9a5-26aae68d1365', '6e4336ec-bad8-4c04-862c-d8d694987fa8', 'a8d5ab8f-eabc-49b2-a73b-fcdeb235e4bb'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-69c251e4-266e-44ca-a53c-933b6e978e01 req-79703d09-f1e1-44e1-ac23-650fcfee1204 tempest-VolumesGetTestJSON-1140781930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-69c251e4-266e-44ca-a53c-933b6e978e01 req-79703d09-f1e1-44e1-ac23-650fcfee1204 tempest-VolumesGetTestJSON-1140781930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [req-69c251e4-266e-44ca-a53c-933b6e978e01 req-79703d09-f1e1-44e1-ac23-650fcfee1204 tempest-VolumesGetTestJSON-1140781930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [req-69c251e4-266e-44ca-a53c-933b6e978e01 req-79703d09-f1e1-44e1-ac23-650fcfee1204 tempest-VolumesGetTestJSON-1140781930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-69c251e4-266e-44ca-a53c-933b6e978e01 req-79703d09-f1e1-44e1-ac23-650fcfee1204 tempest-VolumesGetTestJSON-1140781930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-69c251e4-266e-44ca-a53c-933b6e978e01 req-79703d09-f1e1-44e1-ac23-650fcfee1204 tempest-VolumesGetTestJSON-1140781930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:03 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:42:03 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:03 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-69c251e4-266e-44ca-a53c-933b6e978e01 req-79703d09-f1e1-44e1-ac23-650fcfee1204 tempest-VolumesGetTestJSON-1140781930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.334s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.manager [req-69c251e4-266e-44ca-a53c-933b6e978e01 req-79703d09-f1e1-44e1-ac23-650fcfee1204 tempest-VolumesGetTestJSON-1140781930 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:42:03 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-69c251e4-266e-44ca-a53c-933b6e978e01 req-79703d09-f1e1-44e1-ac23-650fcfee1204 tempest-VolumesGetTestJSON-1140781930 None] Deleted volume successfully. Nov 06 18:42:03 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b7ff3cfc-0777-4e9b-816e-ce47afff869a 1073741824" returned: 0 in 0.716s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-69c251e4-266e-44ca-a53c-933b6e978e01 req-79703d09-f1e1-44e1-ac23-650fcfee1204 tempest-VolumesGetTestJSON-1140781930 None] Lock "cinder-555ce4ab-8323-459a-831b-f01adff54f51-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b7ff3cfc-0777-4e9b-816e-ce47afff869a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:03 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b7ff3cfc-0777-4e9b-816e-ce47afff869a Nov 06 18:42:03 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:04 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b7ff3cfc-0777-4e9b-816e-ce47afff869a" returned: 0 in 0.264s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:42:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.828s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c79aad8-42ce-4ff8-967b-fa91a3a6043b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7ff3cfc-0777-4e9b-816e-ce47afff869a', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e86186-1b01-4401-bd86-f5964fab8bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] Creating offline snapshot 02b167e1-7604-4e95-9b38-3a00dfe9348e of volume 0e1a726a-dada-4aea-b654-577b32508466 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:42:04 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Volume volume-b7ff3cfc-0777-4e9b-816e-ce47afff869a (b7ff3cfc-0777-4e9b-816e-ce47afff869a): created successfully Nov 06 18:42:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e86186-1b01-4401-bd86-f5964fab8bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Flow 'volume_create_manager' (35b64497-4adf-48b8-acd0-bf8839082dd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:04 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1be303-9d15-475c-8693-6d647e5c4cc8]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:04 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-bb85ded4-72f3-4d0f-a949-8967a654817a tempest-VolumesTransfersTest-170299566 None] Created volume successfully. Nov 06 18:42:04 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466 Nov 06 18:42:04 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:04 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466" returned: 0 in 0.487s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.02b167e1-7604-4e95-9b38-3a00dfe9348e 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:04 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.02b167e1-7604-4e95-9b38-3a00dfe9348e 1G Nov 06 18:42:04 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:05 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.02b167e1-7604-4e95-9b38-3a00dfe9348e 1G" returned: 0 in 0.680s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e1a726a-dada-4aea-b654-577b32508466 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.02b167e1-7604-4e95-9b38-3a00dfe9348e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:05 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:42:05 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e1a726a-dada-4aea-b654-577b32508466 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.02b167e1-7604-4e95-9b38-3a00dfe9348e Nov 06 18:42:05 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Flow 'volume_create_manager' (24636ec6-5d11-4665-bb67-ea9d41c5090d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0db8b01-95ff-4837-bcb6-ff2fd19a134c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0db8b01-95ff-4837-bcb6-ff2fd19a134c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1960454914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10dcd822-e6a5-4a8e-aeb0-0e190db68f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='568f5e22051e42c09904a4d00bbe752f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:05Z,use_quota=True,user_id='4a3a8481e01f480c820a7dd6c1d6e7bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c2ad9e-2e87-4659-a696-a0bfb7dd366d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c2ad9e-2e87-4659-a696-a0bfb7dd366d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5077d7bc-32fd-43b5-9c21-98bf8a867df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5077d7bc-32fd-43b5-9c21-98bf8a867df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10dcd822-e6a5-4a8e-aeb0-0e190db68f64', 'volume_name': 'volume-10dcd822-e6a5-4a8e-aeb0-0e190db68f64', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531f454e-9be5-424b-8f8e-71fd08284f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531f454e-9be5-424b-8f8e-71fd08284f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d223d1d7-5263-4cfc-a86d-10460f73f230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:05 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Volume 10dcd822-e6a5-4a8e-aeb0-0e190db68f64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10dcd822-e6a5-4a8e-aeb0-0e190db68f64', 'volume_size': 1} Nov 06 18:42:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:05 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e1a726a-dada-4aea-b654-577b32508466 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.02b167e1-7604-4e95-9b38-3a00dfe9348e" returned: 0 in 0.496s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:05 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.02b167e1-7604-4e95-9b38-3a00dfe9348e is being set with open permissions: ugo+rw: NotImplementedError Nov 06 18:42:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.02b167e1-7604-4e95-9b38-3a00dfe9348e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:06 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.02b167e1-7604-4e95-9b38-3a00dfe9348e Nov 06 18:42:06 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:06 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.02b167e1-7604-4e95-9b38-3a00dfe9348e" returned: 0 in 0.339s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:06 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.info Nov 06 18:42:06 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:06 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-54d8f7a8-bfe2-40a8-aa25-d1542946ab6c tempest-VolumesTransfersTest-142722736 None] Transfer volume completed successfully. Nov 06 18:42:06 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.info" returned: 0 in 0.451s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:06 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 18:42:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:06 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.info Nov 06 18:42:06 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:07 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.info" returned: 0 in 0.268s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.887s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.479s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1960454914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10dcd822-e6a5-4a8e-aeb0-0e190db68f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='568f5e22051e42c09904a4d00bbe752f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:05Z,use_quota=True,user_id='4a3a8481e01f480c820a7dd6c1d6e7bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:42:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Creating volume 10dcd822-e6a5-4a8e-aeb0-0e190db68f64 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:42:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:42:07 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:42:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-10dcd822-e6a5-4a8e-aeb0-0e190db68f64 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:07 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-10dcd822-e6a5-4a8e-aeb0-0e190db68f64 1073741824 Nov 06 18:42:07 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:07 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6d32cd72-cac9-4123-bc0e-221013581fbc tempest-VolumesTransfersTest-1529165511 None] Acquiring lock "cinder-b7ff3cfc-0777-4e9b-816e-ce47afff869a-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:07 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6d32cd72-cac9-4123-bc0e-221013581fbc tempest-VolumesTransfersTest-1529165511 None] Lock "cinder-b7ff3cfc-0777-4e9b-816e-ce47afff869a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:07 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6d32cd72-cac9-4123-bc0e-221013581fbc tempest-VolumesTransfersTest-1529165511 None] Acquiring lock "cinder-quobyte-b7ff3cfc-0777-4e9b-816e-ce47afff869a" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:07 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6d32cd72-cac9-4123-bc0e-221013581fbc tempest-VolumesTransfersTest-1529165511 None] Lock "cinder-quobyte-b7ff3cfc-0777-4e9b-816e-ce47afff869a" acquired by "delete_volume" :: waited 0.038s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:07 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-210677ef-fb32-41a4-8d94-96d1acb26aa1 tempest-GroupSnapshotsV319Test-1952113249 None] group_snapshot b82fc385-a80d-4461-bb13-2ee308b5b033: created successfully Nov 06 18:42:07 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[f216145b-0459-4d5c-adbe-9d41e106101d]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d32cd72-cac9-4123-bc0e-221013581fbc tempest-VolumesTransfersTest-1529165511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b7ff3cfc-0777-4e9b-816e-ce47afff869a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:07 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b7ff3cfc-0777-4e9b-816e-ce47afff869a Nov 06 18:42:07 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:07 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-10dcd822-e6a5-4a8e-aeb0-0e190db68f64 1073741824" returned: 0 in 0.706s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-10dcd822-e6a5-4a8e-aeb0-0e190db68f64 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:07 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-10dcd822-e6a5-4a8e-aeb0-0e190db68f64 Nov 06 18:42:07 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:08 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d32cd72-cac9-4123-bc0e-221013581fbc tempest-VolumesTransfersTest-1529165511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b7ff3cfc-0777-4e9b-816e-ce47afff869a" returned: 0 in 0.595s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d32cd72-cac9-4123-bc0e-221013581fbc tempest-VolumesTransfersTest-1529165511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b7ff3cfc-0777-4e9b-816e-ce47afff869a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:08 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b7ff3cfc-0777-4e9b-816e-ce47afff869a Nov 06 18:42:08 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:08 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-10dcd822-e6a5-4a8e-aeb0-0e190db68f64" returned: 0 in 0.379s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d223d1d7-5263-4cfc-a86d-10460f73f230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10dcd822-e6a5-4a8e-aeb0-0e190db68f64', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693ad09d-5466-4016-957c-5fb4c1d75c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:08 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Volume volume-10dcd822-e6a5-4a8e-aeb0-0e190db68f64 (10dcd822-e6a5-4a8e-aeb0-0e190db68f64): created successfully Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693ad09d-5466-4016-957c-5fb4c1d75c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Flow 'volume_create_manager' (24636ec6-5d11-4665-bb67-ea9d41c5090d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:08 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-89dbe866-cb2d-4943-950a-a71b98366ed1 tempest-TestMinimumBasicScenario-678933044 None] Created volume successfully. Nov 06 18:42:08 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d32cd72-cac9-4123-bc0e-221013581fbc tempest-VolumesTransfersTest-1529165511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b7ff3cfc-0777-4e9b-816e-ce47afff869a" returned: 0 in 0.416s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6d32cd72-cac9-4123-bc0e-221013581fbc tempest-VolumesTransfersTest-1529165511 None] Lock "cinder-quobyte-b7ff3cfc-0777-4e9b-816e-ce47afff869a" released by "delete_volume" :: held 1.093s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-6d32cd72-cac9-4123-bc0e-221013581fbc tempest-VolumesTransfersTest-1529165511 None] Created reservations ['919f5898-8b91-492b-a6a7-44ce72603f4b', '567c74ab-9fae-41d5-a1eb-2051f346d519', 'e7f30292-6b32-4240-aeab-ee570b540009', '65520743-27eb-4d48-b262-458f352c5bcb'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6d32cd72-cac9-4123-bc0e-221013581fbc tempest-VolumesTransfersTest-1529165511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6d32cd72-cac9-4123-bc0e-221013581fbc tempest-VolumesTransfersTest-1529165511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6d32cd72-cac9-4123-bc0e-221013581fbc tempest-VolumesTransfersTest-1529165511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6d32cd72-cac9-4123-bc0e-221013581fbc tempest-VolumesTransfersTest-1529165511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6d32cd72-cac9-4123-bc0e-221013581fbc tempest-VolumesTransfersTest-1529165511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d32cd72-cac9-4123-bc0e-221013581fbc tempest-VolumesTransfersTest-1529165511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:08 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:42:08 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:08 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] group_snapshot b82fc385-a80d-4461-bb13-2ee308b5b033: deleting Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] group_snapshot b82fc385-a80d-4461-bb13-2ee308b5b033: deleting {{(pid=86794) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] Acquiring lock "cinder-quobyte-0e1a726a-dada-4aea-b654-577b32508466" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] Lock "cinder-quobyte-0e1a726a-dada-4aea-b654-577b32508466" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] Acquiring lock "cinder-quobyte-02b167e1-7604-4e95-9b38-3a00dfe9348e" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] Lock "cinder-quobyte-02b167e1-7604-4e95-9b38-3a00dfe9348e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] Deleting offline snapshot 02b167e1-7604-4e95-9b38-3a00dfe9348e of volume 0e1a726a-dada-4aea-b654-577b32508466 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:42:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] snapshot_file for this snap is: volume-0e1a726a-dada-4aea-b654-577b32508466.02b167e1-7604-4e95-9b38-3a00dfe9348e {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:42:09 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc7421f-3772-4567-8850-988bf526ea52]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.02b167e1-7604-4e95-9b38-3a00dfe9348e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:09 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.02b167e1-7604-4e95-9b38-3a00dfe9348e Nov 06 18:42:09 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:09 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d32cd72-cac9-4123-bc0e-221013581fbc tempest-VolumesTransfersTest-1529165511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.551s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:09 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-6d32cd72-cac9-4123-bc0e-221013581fbc tempest-VolumesTransfersTest-1529165511 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:42:09 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-6d32cd72-cac9-4123-bc0e-221013581fbc tempest-VolumesTransfersTest-1529165511 None] Deleted volume successfully. Nov 06 18:42:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6d32cd72-cac9-4123-bc0e-221013581fbc tempest-VolumesTransfersTest-1529165511 None] Lock "cinder-b7ff3cfc-0777-4e9b-816e-ce47afff869a-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:09 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.02b167e1-7604-4e95-9b38-3a00dfe9348e" returned: 0 in 0.650s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e1a726a-dada-4aea-b654-577b32508466(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:42:09 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e770af6-6711-4cb9-a87b-3c8ff980356d]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:09 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466 Nov 06 18:42:09 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:10 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466" returned: 0 in 0.740s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.02b167e1-7604-4e95-9b38-3a00dfe9348e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:10 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.02b167e1-7604-4e95-9b38-3a00dfe9348e Nov 06 18:42:10 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Flow 'volume_create_manager' (6b785a02-2844-41bf-ab50-e77626ab7b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee37b0c-82c6-42a5-93d6-6e21ba03fb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee37b0c-82c6-42a5-93d6-6e21ba03fb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-350772321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61cd866d-dc49-4810-97d1-1fb3d1c5ef5a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f326d6f916b46ac8ffafa79751a1211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:10Z,use_quota=True,user_id='55f35ce4cd764599be191bd2f116c960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73462cd1-d8ca-480e-9028-1a8915f6712f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73462cd1-d8ca-480e-9028-1a8915f6712f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b3473a-6233-4444-80a9-a8dd5d063a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b3473a-6233-4444-80a9-a8dd5d063a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61cd866d-dc49-4810-97d1-1fb3d1c5ef5a', 'volume_name': 'volume-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c6d35fd-b906-4758-b764-e9710434a593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c6d35fd-b906-4758-b764-e9710434a593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19cb0212-1ee1-4b7c-9e92-dc144f714c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:10 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Volume 61cd866d-dc49-4810-97d1-1fb3d1c5ef5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a', 'volume_size': 1} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-350772321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61cd866d-dc49-4810-97d1-1fb3d1c5ef5a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f326d6f916b46ac8ffafa79751a1211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:10Z,use_quota=True,user_id='55f35ce4cd764599be191bd2f116c960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Creating volume 61cd866d-dc49-4810-97d1-1fb3d1c5ef5a {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:42:10 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-93223a8c-5964-4d7a-bc17-725d40303f7a req-ed5fe306-edf6-4916-a3a4-0916d59cdd9d tempest-TestMinimumBasicScenario-678933044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:10 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a 1073741824 Nov 06 18:42:10 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Flow 'volume_create_manager' (10c1688d-5496-4d71-b282-38cd4763fec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3b6b2a-411f-46cd-a422-bd8eb5bf8ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3b6b2a-411f-46cd-a422-bd8eb5bf8ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-775096195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffddc932-65d0-4b71-9082-bc6b19bc3f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ab7eb52d5fc4e2aa474edca88ecc75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:11Z,use_quota=True,user_id='c84a29d4958a4f3c873e2b90a3f5fe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80fd1373-d121-444c-94c5-40e64f17f40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80fd1373-d121-444c-94c5-40e64f17f40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee23f957-ff03-4e25-a2e3-b69f753278b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee23f957-ff03-4e25-a2e3-b69f753278b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffddc932-65d0-4b71-9082-bc6b19bc3f7f', 'volume_name': 'volume-ffddc932-65d0-4b71-9082-bc6b19bc3f7f', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22883f63-3e12-4a35-9041-fecf082fcc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22883f63-3e12-4a35-9041-fecf082fcc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae1a1ee-225a-4601-8de3-a7d6b0b7ae9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:10 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Volume ffddc932-65d0-4b71-9082-bc6b19bc3f7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffddc932-65d0-4b71-9082-bc6b19bc3f7f', 'volume_size': 1} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:10 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.02b167e1-7604-4e95-9b38-3a00dfe9348e" returned: 0 in 0.446s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.02b167e1-7604-4e95-9b38-3a00dfe9348e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:10 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.02b167e1-7604-4e95-9b38-3a00dfe9348e Nov 06 18:42:10 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:11 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a 1073741824" returned: 0 in 0.481s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:11 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466.02b167e1-7604-4e95-9b38-3a00dfe9348e" returned: 0 in 0.298s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] Lock "cinder-quobyte-02b167e1-7604-4e95-9b38-3a00dfe9348e" released by "_delete_snapshot" :: held 2.332s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] Lock "cinder-quobyte-0e1a726a-dada-4aea-b654-577b32508466" released by "delete_snapshot" :: held 2.367s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:11 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a Nov 06 18:42:11 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:11 devstack cinder-volume[86794]: WARNING cinder.quota [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1230394794 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1230394794, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:42:11 devstack cinder-volume[86794]: WARNING cinder.quota [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1230394794 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1230394794, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] Created reservations ['079c98a1-d44c-4e6f-bccd-853e0163e375', 'b04af4f8-ed9a-42e3-a27a-40151bdb5a0e', 'be3c42bc-49d3-4011-b32c-6fcabb558f55', '06e0a098-f326-471a-aac5-50441ee9ef67'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:11 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-7bac3d33-a696-4cd0-9796-e4cb61be5fdf tempest-GroupSnapshotsV319Test-1952113249 None] group_snapshot b82fc385-a80d-4461-bb13-2ee308b5b033: deleted successfully Nov 06 18:42:11 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a" returned: 0 in 0.290s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-93223a8c-5964-4d7a-bc17-725d40303f7a req-ed5fe306-edf6-4916-a3a4-0916d59cdd9d tempest-TestMinimumBasicScenario-678933044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.819s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19cb0212-1ee1-4b7c-9e92-dc144f714c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e068d711-b13a-40fd-bec6-4e34b067a35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-93223a8c-5964-4d7a-bc17-725d40303f7a req-ed5fe306-edf6-4916-a3a4-0916d59cdd9d tempest-TestMinimumBasicScenario-678933044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.743s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-775096195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffddc932-65d0-4b71-9082-bc6b19bc3f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ab7eb52d5fc4e2aa474edca88ecc75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:11Z,use_quota=True,user_id='c84a29d4958a4f3c873e2b90a3f5fe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Creating volume ffddc932-65d0-4b71-9082-bc6b19bc3f7f {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:42:11 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ffddc932-65d0-4b71-9082-bc6b19bc3f7f 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:11 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Volume volume-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a (61cd866d-dc49-4810-97d1-1fb3d1c5ef5a): created successfully Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e068d711-b13a-40fd-bec6-4e34b067a35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:11 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ffddc932-65d0-4b71-9082-bc6b19bc3f7f 1073741824 Nov 06 18:42:11 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Flow 'volume_create_manager' (6b785a02-2844-41bf-ab50-e77626ab7b73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:11 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-d82c00fc-5bd8-4960-890c-8ad29d3c24bf tempest-VolumesTestJSON-1185299134 None] Created volume successfully. Nov 06 18:42:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-93223a8c-5964-4d7a-bc17-725d40303f7a req-ed5fe306-edf6-4916-a3a4-0916d59cdd9d tempest-TestMinimumBasicScenario-678933044 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-10dcd822-e6a5-4a8e-aeb0-0e190db68f64', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30ac37c0-75a7-459a-b637-1e454401b55a', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:42:11 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-93223a8c-5964-4d7a-bc17-725d40303f7a req-ed5fe306-edf6-4916-a3a4-0916d59cdd9d tempest-TestMinimumBasicScenario-678933044 None] attachment_update completed successfully. Nov 06 18:42:12 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ffddc932-65d0-4b71-9082-bc6b19bc3f7f 1073741824" returned: 0 in 0.506s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ffddc932-65d0-4b71-9082-bc6b19bc3f7f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:12 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ffddc932-65d0-4b71-9082-bc6b19bc3f7f Nov 06 18:42:12 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:12 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ffddc932-65d0-4b71-9082-bc6b19bc3f7f" returned: 0 in 0.331s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:12 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:42:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae1a1ee-225a-4601-8de3-a7d6b0b7ae9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffddc932-65d0-4b71-9082-bc6b19bc3f7f', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5175add2-c5de-487f-8867-3d2a7a7efe7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:12 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Volume volume-ffddc932-65d0-4b71-9082-bc6b19bc3f7f (ffddc932-65d0-4b71-9082-bc6b19bc3f7f): created successfully Nov 06 18:42:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5175add2-c5de-487f-8867-3d2a7a7efe7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Flow 'volume_create_manager' (10c1688d-5496-4d71-b282-38cd4763fec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:12 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-898f7e60-d873-4209-9645-9734f209a176 tempest-VolumesTransfersTest-170299566 None] Created volume successfully. Nov 06 18:42:12 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b8c14c00-22d3-4e56-8775-ea9dc53c9401 tempest-GroupSnapshotsV319Test-1952113249 None] Acquiring lock "cinder-quobyte-0e1a726a-dada-4aea-b654-577b32508466" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b8c14c00-22d3-4e56-8775-ea9dc53c9401 tempest-GroupSnapshotsV319Test-1952113249 None] Lock "cinder-quobyte-0e1a726a-dada-4aea-b654-577b32508466" acquired by "delete_volume" :: waited 0.035s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e9bc8f-9774-4ff3-8273-3bcc249563fb]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b8c14c00-22d3-4e56-8775-ea9dc53c9401 tempest-GroupSnapshotsV319Test-1952113249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:13 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466 Nov 06 18:42:13 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Flow 'volume_create_manager' (f3d4dae6-512b-4398-b562-be2d6e8407d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9900a21-6b54-4ed1-9ce8-098c7f184384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9900a21-6b54-4ed1-9ce8-098c7f184384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2049228043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f326d6f916b46ac8ffafa79751a1211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:13Z,use_quota=True,user_id='55f35ce4cd764599be191bd2f116c960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb9aa78-d7d9-4a9a-a1b7-33d66dd6e6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb9aa78-d7d9-4a9a-a1b7-33d66dd6e6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fff81e9-4775-4643-8ce8-21482dc1c26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fff81e9-4775-4643-8ce8-21482dc1c26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb', 'volume_name': 'volume-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4df5821-047d-478b-a534-b4b5529e454c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4df5821-047d-478b-a534-b4b5529e454c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417fd3db-9a4a-453d-821a-1b8085ce81e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:13 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Volume 2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb', 'volume_size': 1} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2049228043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f326d6f916b46ac8ffafa79751a1211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:13Z,use_quota=True,user_id='55f35ce4cd764599be191bd2f116c960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Creating volume 2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:42:13 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:13 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b8c14c00-22d3-4e56-8775-ea9dc53c9401 tempest-GroupSnapshotsV319Test-1952113249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466" returned: 0 in 0.455s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b8c14c00-22d3-4e56-8775-ea9dc53c9401 tempest-GroupSnapshotsV319Test-1952113249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:13 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb 1073741824 Nov 06 18:42:13 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:13 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466 Nov 06 18:42:13 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:13 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b8c14c00-22d3-4e56-8775-ea9dc53c9401 tempest-GroupSnapshotsV319Test-1952113249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e1a726a-dada-4aea-b654-577b32508466" returned: 0 in 0.474s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b8c14c00-22d3-4e56-8775-ea9dc53c9401 tempest-GroupSnapshotsV319Test-1952113249 None] Lock "cinder-quobyte-0e1a726a-dada-4aea-b654-577b32508466" released by "delete_volume" :: held 1.021s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d4f0aea3-56f1-42f1-802d-d09fe2bfeafa tempest-VolumesTransfersTest-1529165511 None] Acquiring lock "cinder-ffddc932-65d0-4b71-9082-bc6b19bc3f7f-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d4f0aea3-56f1-42f1-802d-d09fe2bfeafa tempest-VolumesTransfersTest-1529165511 None] Lock "cinder-ffddc932-65d0-4b71-9082-bc6b19bc3f7f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-b8c14c00-22d3-4e56-8775-ea9dc53c9401 tempest-GroupSnapshotsV319Test-1952113249 None] Created reservations ['d39792fe-b5b9-45b6-8356-80dc5454bcc8'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:14 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d4f0aea3-56f1-42f1-802d-d09fe2bfeafa tempest-VolumesTransfersTest-1529165511 None] Acquiring lock "cinder-quobyte-ffddc932-65d0-4b71-9082-bc6b19bc3f7f" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb 1073741824" returned: 0 in 0.812s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d4f0aea3-56f1-42f1-802d-d09fe2bfeafa tempest-VolumesTransfersTest-1529165511 None] Lock "cinder-quobyte-ffddc932-65d0-4b71-9082-bc6b19bc3f7f" acquired by "delete_volume" :: waited 0.050s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:14 devstack cinder-volume[86794]: WARNING cinder.quota [None req-b8c14c00-22d3-4e56-8775-ea9dc53c9401 tempest-GroupSnapshotsV319Test-1952113249 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1230394794 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1230394794, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7436b7c8-d1a0-4d2c-a751-6ee5a29e9564]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d4f0aea3-56f1-42f1-802d-d09fe2bfeafa tempest-VolumesTransfersTest-1529165511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ffddc932-65d0-4b71-9082-bc6b19bc3f7f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-b8c14c00-22d3-4e56-8775-ea9dc53c9401 tempest-GroupSnapshotsV319Test-1952113249 None] Created reservations ['cac1d89a-fbda-4b08-96ba-699c5c3eeabe', 'f78fb218-bfaa-406d-91c9-38e9e41ed652', '45409321-81dc-4896-8053-8978304feeda', 'aee8d5ea-a9a3-4c9c-afe2-d8bb52e8b9fc'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:14 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb Nov 06 18:42:14 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:14 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ffddc932-65d0-4b71-9082-bc6b19bc3f7f Nov 06 18:42:14 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b8c14c00-22d3-4e56-8775-ea9dc53c9401 tempest-GroupSnapshotsV319Test-1952113249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b8c14c00-22d3-4e56-8775-ea9dc53c9401 tempest-GroupSnapshotsV319Test-1952113249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b8c14c00-22d3-4e56-8775-ea9dc53c9401 tempest-GroupSnapshotsV319Test-1952113249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b8c14c00-22d3-4e56-8775-ea9dc53c9401 tempest-GroupSnapshotsV319Test-1952113249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b8c14c00-22d3-4e56-8775-ea9dc53c9401 tempest-GroupSnapshotsV319Test-1952113249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b8c14c00-22d3-4e56-8775-ea9dc53c9401 tempest-GroupSnapshotsV319Test-1952113249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:14 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb" returned: 0 in 0.403s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:14 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:42:14 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417fd3db-9a4a-453d-821a-1b8085ce81e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64730d49-f77b-463c-96a6-18a19b1e1a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:14 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Volume volume-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb (2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb): created successfully Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64730d49-f77b-463c-96a6-18a19b1e1a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Flow 'volume_create_manager' (f3d4dae6-512b-4398-b562-be2d6e8407d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:14 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a9f84290-e0a4-49b1-81f7-774377096d4b tempest-VolumesTestJSON-1185299134 None] Created volume successfully. Nov 06 18:42:14 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d4f0aea3-56f1-42f1-802d-d09fe2bfeafa tempest-VolumesTransfersTest-1529165511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ffddc932-65d0-4b71-9082-bc6b19bc3f7f" returned: 0 in 0.591s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d4f0aea3-56f1-42f1-802d-d09fe2bfeafa tempest-VolumesTransfersTest-1529165511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ffddc932-65d0-4b71-9082-bc6b19bc3f7f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:15 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ffddc932-65d0-4b71-9082-bc6b19bc3f7f Nov 06 18:42:15 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:15 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b8c14c00-22d3-4e56-8775-ea9dc53c9401 tempest-GroupSnapshotsV319Test-1952113249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.471s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:15 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-b8c14c00-22d3-4e56-8775-ea9dc53c9401 tempest-GroupSnapshotsV319Test-1952113249 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:42:15 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-b8c14c00-22d3-4e56-8775-ea9dc53c9401 tempest-GroupSnapshotsV319Test-1952113249 None] Delete group completed successfully. Nov 06 18:42:15 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d4f0aea3-56f1-42f1-802d-d09fe2bfeafa tempest-VolumesTransfersTest-1529165511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ffddc932-65d0-4b71-9082-bc6b19bc3f7f" returned: 0 in 0.347s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d4f0aea3-56f1-42f1-802d-d09fe2bfeafa tempest-VolumesTransfersTest-1529165511 None] Lock "cinder-quobyte-ffddc932-65d0-4b71-9082-bc6b19bc3f7f" released by "delete_volume" :: held 1.019s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:15 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-d4f0aea3-56f1-42f1-802d-d09fe2bfeafa tempest-VolumesTransfersTest-1529165511 None] Created reservations ['e0ed119c-da72-4e08-b544-a60b0a21ec6d', '92ba141f-d85b-4b3f-bf3d-bb52c6b193cc', '3102166a-1f0e-4864-b81e-e4a9a4d16697', 'ba0f3ed5-acc4-4dfe-9eb1-838a7c668a97'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d4f0aea3-56f1-42f1-802d-d09fe2bfeafa tempest-VolumesTransfersTest-1529165511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d4f0aea3-56f1-42f1-802d-d09fe2bfeafa tempest-VolumesTransfersTest-1529165511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d4f0aea3-56f1-42f1-802d-d09fe2bfeafa tempest-VolumesTransfersTest-1529165511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d4f0aea3-56f1-42f1-802d-d09fe2bfeafa tempest-VolumesTransfersTest-1529165511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d4f0aea3-56f1-42f1-802d-d09fe2bfeafa tempest-VolumesTransfersTest-1529165511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d4f0aea3-56f1-42f1-802d-d09fe2bfeafa tempest-VolumesTransfersTest-1529165511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:15 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:42:15 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:15 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d4f0aea3-56f1-42f1-802d-d09fe2bfeafa tempest-VolumesTransfersTest-1529165511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.356s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:15 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-d4f0aea3-56f1-42f1-802d-d09fe2bfeafa tempest-VolumesTransfersTest-1529165511 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:42:15 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-d4f0aea3-56f1-42f1-802d-d09fe2bfeafa tempest-VolumesTransfersTest-1529165511 None] Deleted volume successfully. Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d4f0aea3-56f1-42f1-802d-d09fe2bfeafa tempest-VolumesTransfersTest-1529165511 None] Lock "cinder-ffddc932-65d0-4b71-9082-bc6b19bc3f7f-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Flow 'volume_create_manager' (3b055c1f-154a-4db4-8f7f-8b63794c7120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6817bc16-f010-4400-8203-e9c2e454e796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6817bc16-f010-4400-8203-e9c2e454e796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1510910172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650978a8-2299-4492-aa8c-df608d1fd52f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f326d6f916b46ac8ffafa79751a1211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:16Z,use_quota=True,user_id='55f35ce4cd764599be191bd2f116c960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe3fde7-e82f-4fc4-9957-94b798a8e679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe3fde7-e82f-4fc4-9957-94b798a8e679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de0bb29a-d4e4-43b8-9ff7-61df2ffcc565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de0bb29a-d4e4-43b8-9ff7-61df2ffcc565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '650978a8-2299-4492-aa8c-df608d1fd52f', 'volume_name': 'volume-650978a8-2299-4492-aa8c-df608d1fd52f', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d560c39-3e86-44a9-87fb-be50a23b4eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d560c39-3e86-44a9-87fb-be50a23b4eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69324ac7-44ab-4d2e-80bd-17348caa8599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:16 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Volume 650978a8-2299-4492-aa8c-df608d1fd52f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-650978a8-2299-4492-aa8c-df608d1fd52f', 'volume_size': 1} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1510910172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650978a8-2299-4492-aa8c-df608d1fd52f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f326d6f916b46ac8ffafa79751a1211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:16Z,use_quota=True,user_id='55f35ce4cd764599be191bd2f116c960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Creating volume 650978a8-2299-4492-aa8c-df608d1fd52f {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:42:16 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:42:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-650978a8-2299-4492-aa8c-df608d1fd52f 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:16 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-650978a8-2299-4492-aa8c-df608d1fd52f 1073741824 Nov 06 18:42:16 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:17 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-650978a8-2299-4492-aa8c-df608d1fd52f 1073741824" returned: 0 in 0.624s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-650978a8-2299-4492-aa8c-df608d1fd52f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:17 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-650978a8-2299-4492-aa8c-df608d1fd52f Nov 06 18:42:17 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:17 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-650978a8-2299-4492-aa8c-df608d1fd52f" returned: 0 in 0.287s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:42:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69324ac7-44ab-4d2e-80bd-17348caa8599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-650978a8-2299-4492-aa8c-df608d1fd52f', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7635f402-51d8-4440-a0f7-06f8201be257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:17 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Volume volume-650978a8-2299-4492-aa8c-df608d1fd52f (650978a8-2299-4492-aa8c-df608d1fd52f): created successfully Nov 06 18:42:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7635f402-51d8-4440-a0f7-06f8201be257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Flow 'volume_create_manager' (3b055c1f-154a-4db4-8f7f-8b63794c7120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:17 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-bacae0d4-1539-405a-b962-fb233169aeb5 tempest-VolumesTestJSON-1185299134 None] Created volume successfully. Nov 06 18:42:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f000356e-6bf2-4ff9-b1e4-71d913325d9f tempest-VolumesTestJSON-1185299134 None] Acquiring lock "cinder-650978a8-2299-4492-aa8c-df608d1fd52f-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f000356e-6bf2-4ff9-b1e4-71d913325d9f tempest-VolumesTestJSON-1185299134 None] Lock "cinder-650978a8-2299-4492-aa8c-df608d1fd52f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f000356e-6bf2-4ff9-b1e4-71d913325d9f tempest-VolumesTestJSON-1185299134 None] Acquiring lock "cinder-quobyte-650978a8-2299-4492-aa8c-df608d1fd52f" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f000356e-6bf2-4ff9-b1e4-71d913325d9f tempest-VolumesTestJSON-1185299134 None] Lock "cinder-quobyte-650978a8-2299-4492-aa8c-df608d1fd52f" acquired by "delete_volume" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:19 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7775e1c9-ca46-4701-998c-5b946f74a343]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f000356e-6bf2-4ff9-b1e4-71d913325d9f tempest-VolumesTestJSON-1185299134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-650978a8-2299-4492-aa8c-df608d1fd52f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:19 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-650978a8-2299-4492-aa8c-df608d1fd52f Nov 06 18:42:19 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:20 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f000356e-6bf2-4ff9-b1e4-71d913325d9f tempest-VolumesTestJSON-1185299134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-650978a8-2299-4492-aa8c-df608d1fd52f" returned: 0 in 0.467s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f000356e-6bf2-4ff9-b1e4-71d913325d9f tempest-VolumesTestJSON-1185299134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-650978a8-2299-4492-aa8c-df608d1fd52f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:20 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-650978a8-2299-4492-aa8c-df608d1fd52f Nov 06 18:42:20 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:20 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f000356e-6bf2-4ff9-b1e4-71d913325d9f tempest-VolumesTestJSON-1185299134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-650978a8-2299-4492-aa8c-df608d1fd52f" returned: 0 in 0.393s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f000356e-6bf2-4ff9-b1e4-71d913325d9f tempest-VolumesTestJSON-1185299134 None] Lock "cinder-quobyte-650978a8-2299-4492-aa8c-df608d1fd52f" released by "delete_volume" :: held 0.941s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:20 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-f000356e-6bf2-4ff9-b1e4-71d913325d9f tempest-VolumesTestJSON-1185299134 None] Created reservations ['bc6c452b-36b4-40c3-ba6e-efe601b42bcc', '58e693b9-846e-4c48-bc16-793de75cacda', 'b36ba417-7300-4de1-9eed-72f4337585b3', '4d2c5e9a-48a0-44e3-8806-23a16c4c6cb4'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f000356e-6bf2-4ff9-b1e4-71d913325d9f tempest-VolumesTestJSON-1185299134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f000356e-6bf2-4ff9-b1e4-71d913325d9f tempest-VolumesTestJSON-1185299134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f000356e-6bf2-4ff9-b1e4-71d913325d9f tempest-VolumesTestJSON-1185299134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f000356e-6bf2-4ff9-b1e4-71d913325d9f tempest-VolumesTestJSON-1185299134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f000356e-6bf2-4ff9-b1e4-71d913325d9f tempest-VolumesTestJSON-1185299134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f000356e-6bf2-4ff9-b1e4-71d913325d9f tempest-VolumesTestJSON-1185299134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:20 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:42:20 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3a233a24-bbcb-4c71-94ac-a4ec5f85ad8a tempest-VolumesTestJSON-1185299134 None] Acquiring lock "cinder-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3a233a24-bbcb-4c71-94ac-a4ec5f85ad8a tempest-VolumesTestJSON-1185299134 None] Lock "cinder-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3a233a24-bbcb-4c71-94ac-a4ec5f85ad8a tempest-VolumesTestJSON-1185299134 None] Acquiring lock "cinder-quobyte-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3a233a24-bbcb-4c71-94ac-a4ec5f85ad8a tempest-VolumesTestJSON-1185299134 None] Lock "cinder-quobyte-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb" acquired by "delete_volume" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:21 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[44afbef9-85e0-473b-94fd-2342274ab1a0]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3a233a24-bbcb-4c71-94ac-a4ec5f85ad8a tempest-VolumesTestJSON-1185299134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:21 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f000356e-6bf2-4ff9-b1e4-71d913325d9f tempest-VolumesTestJSON-1185299134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.499s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:21 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-f000356e-6bf2-4ff9-b1e4-71d913325d9f tempest-VolumesTestJSON-1185299134 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:42:21 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-f000356e-6bf2-4ff9-b1e4-71d913325d9f tempest-VolumesTestJSON-1185299134 None] Deleted volume successfully. Nov 06 18:42:21 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb Nov 06 18:42:21 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f000356e-6bf2-4ff9-b1e4-71d913325d9f tempest-VolumesTestJSON-1185299134 None] Lock "cinder-650978a8-2299-4492-aa8c-df608d1fd52f-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:21 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3a233a24-bbcb-4c71-94ac-a4ec5f85ad8a tempest-VolumesTestJSON-1185299134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb" returned: 0 in 0.577s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3a233a24-bbcb-4c71-94ac-a4ec5f85ad8a tempest-VolumesTestJSON-1185299134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:21 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb Nov 06 18:42:21 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:22 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3a233a24-bbcb-4c71-94ac-a4ec5f85ad8a tempest-VolumesTestJSON-1185299134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb" returned: 0 in 0.406s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3a233a24-bbcb-4c71-94ac-a4ec5f85ad8a tempest-VolumesTestJSON-1185299134 None] Lock "cinder-quobyte-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb" released by "delete_volume" :: held 1.088s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:22 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-3a233a24-bbcb-4c71-94ac-a4ec5f85ad8a tempest-VolumesTestJSON-1185299134 None] Created reservations ['df5b4e3e-a418-4357-a592-c0ba55553fda', '7c5ac867-1c92-43e9-a0eb-b6c65dad995b', '9760042c-725c-490c-8f20-49dc5d84bbcd', '48d1634b-9f5e-4b47-9b51-3e8186886e07'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3a233a24-bbcb-4c71-94ac-a4ec5f85ad8a tempest-VolumesTestJSON-1185299134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3a233a24-bbcb-4c71-94ac-a4ec5f85ad8a tempest-VolumesTestJSON-1185299134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:22 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3a233a24-bbcb-4c71-94ac-a4ec5f85ad8a tempest-VolumesTestJSON-1185299134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:22 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3a233a24-bbcb-4c71-94ac-a4ec5f85ad8a tempest-VolumesTestJSON-1185299134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3a233a24-bbcb-4c71-94ac-a4ec5f85ad8a tempest-VolumesTestJSON-1185299134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3a233a24-bbcb-4c71-94ac-a4ec5f85ad8a tempest-VolumesTestJSON-1185299134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:22 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:42:22 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:22 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3a233a24-bbcb-4c71-94ac-a4ec5f85ad8a tempest-VolumesTestJSON-1185299134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.328s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:22 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-3a233a24-bbcb-4c71-94ac-a4ec5f85ad8a tempest-VolumesTestJSON-1185299134 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:42:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-3a233a24-bbcb-4c71-94ac-a4ec5f85ad8a tempest-VolumesTestJSON-1185299134 None] Deleted volume successfully. Nov 06 18:42:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3a233a24-bbcb-4c71-94ac-a4ec5f85ad8a tempest-VolumesTestJSON-1185299134 None] Lock "cinder-2ca7d1cf-0de1-4eaf-994a-611e3aa18cbb-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ceae9cd2-5ad4-4d2c-91fc-402f86e79a92 tempest-VolumesTestJSON-1185299134 None] Acquiring lock "cinder-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ceae9cd2-5ad4-4d2c-91fc-402f86e79a92 tempest-VolumesTestJSON-1185299134 None] Lock "cinder-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ceae9cd2-5ad4-4d2c-91fc-402f86e79a92 tempest-VolumesTestJSON-1185299134 None] Acquiring lock "cinder-quobyte-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ceae9cd2-5ad4-4d2c-91fc-402f86e79a92 tempest-VolumesTestJSON-1185299134 None] Lock "cinder-quobyte-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a" acquired by "delete_volume" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:23 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[d613a6f4-c725-4f9b-92d2-83c52232b357]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ceae9cd2-5ad4-4d2c-91fc-402f86e79a92 tempest-VolumesTestJSON-1185299134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:23 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a Nov 06 18:42:23 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:24 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ceae9cd2-5ad4-4d2c-91fc-402f86e79a92 tempest-VolumesTestJSON-1185299134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a" returned: 0 in 0.547s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ceae9cd2-5ad4-4d2c-91fc-402f86e79a92 tempest-VolumesTestJSON-1185299134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:24 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a Nov 06 18:42:24 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:24 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ceae9cd2-5ad4-4d2c-91fc-402f86e79a92 tempest-VolumesTestJSON-1185299134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a" returned: 0 in 0.309s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:24 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ceae9cd2-5ad4-4d2c-91fc-402f86e79a92 tempest-VolumesTestJSON-1185299134 None] Lock "cinder-quobyte-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a" released by "delete_volume" :: held 0.934s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:24 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-ceae9cd2-5ad4-4d2c-91fc-402f86e79a92 tempest-VolumesTestJSON-1185299134 None] Created reservations ['4a9ccd23-fd92-41e9-81f8-0414cb6f08a0', '678e88da-fcce-4962-986c-5c9ad8a4cdcf', 'a94026af-9166-4ef2-80d7-fd3fb4bb65cb', 'ea1ba40d-073a-496e-a76f-924a24ed179d'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ceae9cd2-5ad4-4d2c-91fc-402f86e79a92 tempest-VolumesTestJSON-1185299134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ceae9cd2-5ad4-4d2c-91fc-402f86e79a92 tempest-VolumesTestJSON-1185299134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ceae9cd2-5ad4-4d2c-91fc-402f86e79a92 tempest-VolumesTestJSON-1185299134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ceae9cd2-5ad4-4d2c-91fc-402f86e79a92 tempest-VolumesTestJSON-1185299134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ceae9cd2-5ad4-4d2c-91fc-402f86e79a92 tempest-VolumesTestJSON-1185299134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ceae9cd2-5ad4-4d2c-91fc-402f86e79a92 tempest-VolumesTestJSON-1185299134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:24 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:42:24 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:24 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-3637327e-5fd2-4d71-8121-c8e7f063c0dc tempest-GroupsTest-1241171573 None] Group tempest-Group1-1915486388: creating Nov 06 18:42:24 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-3637327e-5fd2-4d71-8121-c8e7f063c0dc tempest-GroupsTest-1241171573 None] Group tempest-Group1-1915486388: created successfully Nov 06 18:42:24 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-3637327e-5fd2-4d71-8121-c8e7f063c0dc tempest-GroupsTest-1241171573 None] Create group completed successfully. Nov 06 18:42:25 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ceae9cd2-5ad4-4d2c-91fc-402f86e79a92 tempest-VolumesTestJSON-1185299134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.306s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:25 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-ceae9cd2-5ad4-4d2c-91fc-402f86e79a92 tempest-VolumesTestJSON-1185299134 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:42:25 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-ceae9cd2-5ad4-4d2c-91fc-402f86e79a92 tempest-VolumesTestJSON-1185299134 None] Deleted volume successfully. Nov 06 18:42:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ceae9cd2-5ad4-4d2c-91fc-402f86e79a92 tempest-VolumesTestJSON-1185299134 None] Lock "cinder-61cd866d-dc49-4810-97d1-1fb3d1c5ef5a-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:25 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:42:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Flow 'volume_create_manager' (9f7c48c8-c1b1-4512-9a45-70bbfb6350c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2760ec5-4b98-4ec2-a6d2-49accf194722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2760ec5-4b98-4ec2-a6d2-49accf194722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1359096457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7217a44b-98cf-4365-994f-105c9999e4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f69a59be5247b3a82d171042171230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:26Z,use_quota=True,user_id='4960acac89c644d3b2ff336282b5397e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21ad906-57d0-4e0d-9a62-b64611f22f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21ad906-57d0-4e0d-9a62-b64611f22f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9356c8a-58a1-4295-982b-d5a89adf0741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9356c8a-58a1-4295-982b-d5a89adf0741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7217a44b-98cf-4365-994f-105c9999e4b7', 'volume_name': 'volume-7217a44b-98cf-4365-994f-105c9999e4b7', 'volume_size': 2}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b469dc5c-71b8-4980-8861-da3ead8b54a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b469dc5c-71b8-4980-8861-da3ead8b54a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3356c38-ea55-432c-a929-7de176b6db9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:26 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Volume 7217a44b-98cf-4365-994f-105c9999e4b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7217a44b-98cf-4365-994f-105c9999e4b7', 'volume_size': 2} Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1359096457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7217a44b-98cf-4365-994f-105c9999e4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f69a59be5247b3a82d171042171230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:26Z,use_quota=True,user_id='4960acac89c644d3b2ff336282b5397e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Creating volume 7217a44b-98cf-4365-994f-105c9999e4b7 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:42:26 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7217a44b-98cf-4365-994f-105c9999e4b7 2147483648 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:26 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-8b463b71-6478-4626-b954-f82bdc8a623d tempest-GroupsTest-1241171573 None] Group tempest-Group2-1210854674: creating Nov 06 18:42:26 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7217a44b-98cf-4365-994f-105c9999e4b7 2147483648 Nov 06 18:42:26 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:26 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-8b463b71-6478-4626-b954-f82bdc8a623d tempest-GroupsTest-1241171573 None] Group tempest-Group2-1210854674: created successfully Nov 06 18:42:26 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-8b463b71-6478-4626-b954-f82bdc8a623d tempest-GroupsTest-1241171573 None] Create group completed successfully. Nov 06 18:42:26 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7217a44b-98cf-4365-994f-105c9999e4b7 2147483648" returned: 0 in 0.620s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7217a44b-98cf-4365-994f-105c9999e4b7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:26 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7217a44b-98cf-4365-994f-105c9999e4b7 Nov 06 18:42:26 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:27 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7217a44b-98cf-4365-994f-105c9999e4b7" returned: 0 in 0.337s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3356c38-ea55-432c-a929-7de176b6db9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7217a44b-98cf-4365-994f-105c9999e4b7', 'volume_size': 2}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41bc5d87-375e-4e79-aa92-8e4c489785d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:27 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Volume volume-7217a44b-98cf-4365-994f-105c9999e4b7 (7217a44b-98cf-4365-994f-105c9999e4b7): created successfully Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41bc5d87-375e-4e79-aa92-8e4c489785d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Flow 'volume_create_manager' (9f7c48c8-c1b1-4512-9a45-70bbfb6350c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:27 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-06c2d9ef-0b86-492e-9608-e2d87663d2a4 tempest-VolumesCloneNegativeTest-1885846368 None] Created volume successfully. Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Flow 'volume_create_manager' (874eba0f-9f18-4fd0-b3fd-99da9de2e349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5922bb15-a2e3-4ab6-8134-19bb49a88613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5922bb15-a2e3-4ab6-8134-19bb49a88613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-273526822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df2f5bac-b3c0-49cc-873c-00b2a0a633b3,host='devstack@QuobyteHD#QuobyteHD',id=e562b35d-69ad-45bc-bae9-16bf395ae51c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247527fec6444689be5d6c7244811c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:28Z,use_quota=True,user_id='a515d7b36bbe4366a2fb353d42668256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23672159-3307-47a4-830b-913c09a7b3ae),volume_type_id=23672159-3307-47a4-830b-913c09a7b3ae)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa3751f-713f-413c-a1cd-e8622afb7c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa3751f-713f-413c-a1cd-e8622afb7c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1942ce56-614d-444d-9820-495065146479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1942ce56-614d-444d-9820-495065146479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e562b35d-69ad-45bc-bae9-16bf395ae51c', 'volume_name': 'volume-e562b35d-69ad-45bc-bae9-16bf395ae51c', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf40c1bc-1750-41e1-b4e9-6546030a2c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf40c1bc-1750-41e1-b4e9-6546030a2c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811fb743-2dd8-4d1f-ac3c-297ca2c19d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:27 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Volume e562b35d-69ad-45bc-bae9-16bf395ae51c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e562b35d-69ad-45bc-bae9-16bf395ae51c', 'volume_size': 1} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=df2f5bac-b3c0-49cc-873c-00b2a0a633b3,created_at=2026-11-06T17:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-273526822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df2f5bac-b3c0-49cc-873c-00b2a0a633b3,host='devstack@QuobyteHD#QuobyteHD',id=e562b35d-69ad-45bc-bae9-16bf395ae51c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247527fec6444689be5d6c7244811c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:28Z,use_quota=True,user_id='a515d7b36bbe4366a2fb353d42668256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23672159-3307-47a4-830b-913c09a7b3ae),volume_type_id=23672159-3307-47a4-830b-913c09a7b3ae)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Creating volume e562b35d-69ad-45bc-bae9-16bf395ae51c {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:42:27 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:42:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e562b35d-69ad-45bc-bae9-16bf395ae51c 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:27 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e562b35d-69ad-45bc-bae9-16bf395ae51c 1073741824 Nov 06 18:42:27 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:28 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2850e0f1-5523-4cf1-aaf7-5ba12442a661 tempest-VolumesCloneNegativeTest-1885846368 None] Acquiring lock "cinder-7217a44b-98cf-4365-994f-105c9999e4b7-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:28 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2850e0f1-5523-4cf1-aaf7-5ba12442a661 tempest-VolumesCloneNegativeTest-1885846368 None] Lock "cinder-7217a44b-98cf-4365-994f-105c9999e4b7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:28 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2850e0f1-5523-4cf1-aaf7-5ba12442a661 tempest-VolumesCloneNegativeTest-1885846368 None] Acquiring lock "cinder-quobyte-7217a44b-98cf-4365-994f-105c9999e4b7" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:28 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2850e0f1-5523-4cf1-aaf7-5ba12442a661 tempest-VolumesCloneNegativeTest-1885846368 None] Lock "cinder-quobyte-7217a44b-98cf-4365-994f-105c9999e4b7" acquired by "delete_volume" :: waited 0.018s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:28 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf392aa6-1a78-4e8b-a58b-52b9a128f917]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2850e0f1-5523-4cf1-aaf7-5ba12442a661 tempest-VolumesCloneNegativeTest-1885846368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7217a44b-98cf-4365-994f-105c9999e4b7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:28 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e562b35d-69ad-45bc-bae9-16bf395ae51c 1073741824" returned: 0 in 0.530s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:28 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7217a44b-98cf-4365-994f-105c9999e4b7 Nov 06 18:42:28 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e562b35d-69ad-45bc-bae9-16bf395ae51c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:28 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e562b35d-69ad-45bc-bae9-16bf395ae51c Nov 06 18:42:28 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:28 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e562b35d-69ad-45bc-bae9-16bf395ae51c" returned: 0 in 0.267s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:42:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:28 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2850e0f1-5523-4cf1-aaf7-5ba12442a661 tempest-VolumesCloneNegativeTest-1885846368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7217a44b-98cf-4365-994f-105c9999e4b7" returned: 0 in 0.424s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2850e0f1-5523-4cf1-aaf7-5ba12442a661 tempest-VolumesCloneNegativeTest-1885846368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7217a44b-98cf-4365-994f-105c9999e4b7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811fb743-2dd8-4d1f-ac3c-297ca2c19d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e562b35d-69ad-45bc-bae9-16bf395ae51c', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:28 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7217a44b-98cf-4365-994f-105c9999e4b7 Nov 06 18:42:28 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6098f5-6b1c-4988-9a54-fa0fd10de331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:28 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Volume volume-e562b35d-69ad-45bc-bae9-16bf395ae51c (e562b35d-69ad-45bc-bae9-16bf395ae51c): created successfully Nov 06 18:42:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6098f5-6b1c-4988-9a54-fa0fd10de331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Flow 'volume_create_manager' (874eba0f-9f18-4fd0-b3fd-99da9de2e349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:28 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-eb50ecf3-6faf-49d1-ba13-b2a050fb7dfe tempest-GroupsTest-1241171573 None] Created volume successfully. Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:29 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2850e0f1-5523-4cf1-aaf7-5ba12442a661 tempest-VolumesCloneNegativeTest-1885846368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7217a44b-98cf-4365-994f-105c9999e4b7" returned: 0 in 0.338s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:29 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:42:29 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2850e0f1-5523-4cf1-aaf7-5ba12442a661 tempest-VolumesCloneNegativeTest-1885846368 None] Lock "cinder-quobyte-7217a44b-98cf-4365-994f-105c9999e4b7" released by "delete_volume" :: held 0.813s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-2850e0f1-5523-4cf1-aaf7-5ba12442a661 tempest-VolumesCloneNegativeTest-1885846368 None] Created reservations ['382fb8a4-846b-43f8-af4d-58a1528080a5', 'e998029f-7b10-41b1-ab98-5a62a8dcc2e2', 'aed8c7a1-fb1b-4307-9e11-15daaf74ce32', 'f2c586a7-2f0b-48ae-9229-8471dc6163e4'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2850e0f1-5523-4cf1-aaf7-5ba12442a661 tempest-VolumesCloneNegativeTest-1885846368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2850e0f1-5523-4cf1-aaf7-5ba12442a661 tempest-VolumesCloneNegativeTest-1885846368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2850e0f1-5523-4cf1-aaf7-5ba12442a661 tempest-VolumesCloneNegativeTest-1885846368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2850e0f1-5523-4cf1-aaf7-5ba12442a661 tempest-VolumesCloneNegativeTest-1885846368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2850e0f1-5523-4cf1-aaf7-5ba12442a661 tempest-VolumesCloneNegativeTest-1885846368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2850e0f1-5523-4cf1-aaf7-5ba12442a661 tempest-VolumesCloneNegativeTest-1885846368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:29 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:42:29 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:29 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.329s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 29 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:42:29 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2850e0f1-5523-4cf1-aaf7-5ba12442a661 tempest-VolumesCloneNegativeTest-1885846368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.318s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-2850e0f1-5523-4cf1-aaf7-5ba12442a661 tempest-VolumesCloneNegativeTest-1885846368 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:42:29 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-2850e0f1-5523-4cf1-aaf7-5ba12442a661 tempest-VolumesCloneNegativeTest-1885846368 None] Deleted volume successfully. Nov 06 18:42:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2850e0f1-5523-4cf1-aaf7-5ba12442a661 tempest-VolumesCloneNegativeTest-1885846368 None] Lock "cinder-7217a44b-98cf-4365-994f-105c9999e4b7-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d863ffe8-13ca-4167-822a-db5a9eb07dc0 tempest-GroupsTest-1241171573 None] Acquiring lock "cinder-quobyte-e562b35d-69ad-45bc-bae9-16bf395ae51c" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d863ffe8-13ca-4167-822a-db5a9eb07dc0 tempest-GroupsTest-1241171573 None] Lock "cinder-quobyte-e562b35d-69ad-45bc-bae9-16bf395ae51c" acquired by "delete_volume" :: waited 0.031s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:30 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[02aa2b39-ec52-429e-82fa-b40949a7780a]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d863ffe8-13ca-4167-822a-db5a9eb07dc0 tempest-GroupsTest-1241171573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e562b35d-69ad-45bc-bae9-16bf395ae51c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:30 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e562b35d-69ad-45bc-bae9-16bf395ae51c Nov 06 18:42:30 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:30 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d863ffe8-13ca-4167-822a-db5a9eb07dc0 tempest-GroupsTest-1241171573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e562b35d-69ad-45bc-bae9-16bf395ae51c" returned: 0 in 0.566s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d863ffe8-13ca-4167-822a-db5a9eb07dc0 tempest-GroupsTest-1241171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e562b35d-69ad-45bc-bae9-16bf395ae51c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:30 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e562b35d-69ad-45bc-bae9-16bf395ae51c Nov 06 18:42:30 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:31 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d863ffe8-13ca-4167-822a-db5a9eb07dc0 tempest-GroupsTest-1241171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e562b35d-69ad-45bc-bae9-16bf395ae51c" returned: 0 in 0.305s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:31 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d863ffe8-13ca-4167-822a-db5a9eb07dc0 tempest-GroupsTest-1241171573 None] Lock "cinder-quobyte-e562b35d-69ad-45bc-bae9-16bf395ae51c" released by "delete_volume" :: held 0.964s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:31 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-d863ffe8-13ca-4167-822a-db5a9eb07dc0 tempest-GroupsTest-1241171573 None] Created reservations ['33cae8fa-6c41-4780-a676-0831378dd0f0'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:31 devstack cinder-volume[86794]: WARNING cinder.quota [None req-d863ffe8-13ca-4167-822a-db5a9eb07dc0 tempest-GroupsTest-1241171573 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2123972435 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2123972435, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:42:31 devstack cinder-volume[86794]: WARNING cinder.quota [None req-d863ffe8-13ca-4167-822a-db5a9eb07dc0 tempest-GroupsTest-1241171573 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2123972435 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2123972435, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:42:31 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-d863ffe8-13ca-4167-822a-db5a9eb07dc0 tempest-GroupsTest-1241171573 None] Created reservations ['8a5e69d3-984d-4f16-9afb-d4ffeca9deeb', 'd288f7b9-2d89-4365-bd1b-d106de885f92', '592eca21-be35-4340-ba2f-52a641ce55ea', '49fd75e0-cf59-4364-ad15-d629d3cf1ab4'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d863ffe8-13ca-4167-822a-db5a9eb07dc0 tempest-GroupsTest-1241171573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d863ffe8-13ca-4167-822a-db5a9eb07dc0 tempest-GroupsTest-1241171573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d863ffe8-13ca-4167-822a-db5a9eb07dc0 tempest-GroupsTest-1241171573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d863ffe8-13ca-4167-822a-db5a9eb07dc0 tempest-GroupsTest-1241171573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d863ffe8-13ca-4167-822a-db5a9eb07dc0 tempest-GroupsTest-1241171573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d863ffe8-13ca-4167-822a-db5a9eb07dc0 tempest-GroupsTest-1241171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:31 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:42:31 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:31 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d863ffe8-13ca-4167-822a-db5a9eb07dc0 tempest-GroupsTest-1241171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.454s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:31 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-d863ffe8-13ca-4167-822a-db5a9eb07dc0 tempest-GroupsTest-1241171573 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:42:31 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-d863ffe8-13ca-4167-822a-db5a9eb07dc0 tempest-GroupsTest-1241171573 None] Delete group completed successfully. Nov 06 18:42:32 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-61025cd7-e963-43e6-a4af-c80d2cff5793 tempest-GroupsTest-1241171573 None] Created reservations ['1a8fc6a2-b65a-43e5-905f-42bf4da4d5e3'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-61025cd7-e963-43e6-a4af-c80d2cff5793 tempest-GroupsTest-1241171573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-61025cd7-e963-43e6-a4af-c80d2cff5793 tempest-GroupsTest-1241171573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:32 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-61025cd7-e963-43e6-a4af-c80d2cff5793 tempest-GroupsTest-1241171573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:32 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-61025cd7-e963-43e6-a4af-c80d2cff5793 tempest-GroupsTest-1241171573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-61025cd7-e963-43e6-a4af-c80d2cff5793 tempest-GroupsTest-1241171573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-61025cd7-e963-43e6-a4af-c80d2cff5793 tempest-GroupsTest-1241171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:32 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:42:32 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:33 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-61025cd7-e963-43e6-a4af-c80d2cff5793 tempest-GroupsTest-1241171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.339s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:33 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-61025cd7-e963-43e6-a4af-c80d2cff5793 tempest-GroupsTest-1241171573 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:42:33 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-61025cd7-e963-43e6-a4af-c80d2cff5793 tempest-GroupsTest-1241171573 None] Delete group completed successfully. Nov 06 18:42:34 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-942b6988-d58b-4bab-a41d-a238ec3a72df tempest-GroupsTest-1241171573 None] Group tempest-GroupsTest-Group-1469397014: creating Nov 06 18:42:34 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-942b6988-d58b-4bab-a41d-a238ec3a72df tempest-GroupsTest-1241171573 None] Group tempest-GroupsTest-Group-1469397014: created successfully Nov 06 18:42:34 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-942b6988-d58b-4bab-a41d-a238ec3a72df tempest-GroupsTest-1241171573 None] Create group completed successfully. Nov 06 18:42:34 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:42:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Flow 'volume_create_manager' (ba9610f4-8d58-404a-b362-8f0629fb0fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b555699-4c07-4e62-bb5c-1dade1ba75a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b555699-4c07-4e62-bb5c-1dade1ba75a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-830475906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4749e7d2-adc4-4460-a044-d1ae545f3787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58cb8edbcdc448e9b29f556ed2348f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:35Z,use_quota=True,user_id='9d20481feaaf431299687e12a1b83566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887068c7-d27f-4a3c-96cb-7d2bef0a6c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887068c7-d27f-4a3c-96cb-7d2bef0a6c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664f6ced-5c87-4399-9209-9b052ea551e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664f6ced-5c87-4399-9209-9b052ea551e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4749e7d2-adc4-4460-a044-d1ae545f3787', 'volume_name': 'volume-4749e7d2-adc4-4460-a044-d1ae545f3787', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3b42be-6735-437c-a242-1616d900cdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3b42be-6735-437c-a242-1616d900cdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2be42a7-c9ef-4921-bc2e-cd0930032e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:35 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Volume 4749e7d2-adc4-4460-a044-d1ae545f3787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4749e7d2-adc4-4460-a044-d1ae545f3787', 'volume_size': 1} Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-830475906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4749e7d2-adc4-4460-a044-d1ae545f3787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58cb8edbcdc448e9b29f556ed2348f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:35Z,use_quota=True,user_id='9d20481feaaf431299687e12a1b83566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Creating volume 4749e7d2-adc4-4460-a044-d1ae545f3787 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:42:35 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:35 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787 1073741824 Nov 06 18:42:35 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:35 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787 1073741824" returned: 0 in 0.490s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:35 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787 Nov 06 18:42:35 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:35 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787" returned: 0 in 0.365s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2be42a7-c9ef-4921-bc2e-cd0930032e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4749e7d2-adc4-4460-a044-d1ae545f3787', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf301fb-dfd5-4224-87aa-fb5df56d788b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:35 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Volume volume-4749e7d2-adc4-4460-a044-d1ae545f3787 (4749e7d2-adc4-4460-a044-d1ae545f3787): created successfully Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf301fb-dfd5-4224-87aa-fb5df56d788b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Flow 'volume_create_manager' (ba9610f4-8d58-404a-b362-8f0629fb0fd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:35 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-cd07c2d3-0df2-473d-9d66-5a92af163472 tempest-VolumesSnapshotListTestJSON-1305120745 None] Created volume successfully. Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Flow 'volume_create_manager' (5176cccb-68e4-4142-b1cc-ca6aa7383ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428ae0ac-d638-4af0-b0d4-9a9e9f2b4fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428ae0ac-d638-4af0-b0d4-9a9e9f2b4fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-134135938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=115fa4e2-8440-4ee4-9cc7-c74e4c5160c7,host='devstack@QuobyteHD#QuobyteHD',id=34959762-db2a-4b23-a996-3808c542c580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247527fec6444689be5d6c7244811c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:36Z,use_quota=True,user_id='a515d7b36bbe4366a2fb353d42668256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dde898b-cc6a-440f-9334-9cebb3a2061a),volume_type_id=0dde898b-cc6a-440f-9334-9cebb3a2061a)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6758aa4-9d39-4d5e-abe9-87be368d716f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6758aa4-9d39-4d5e-abe9-87be368d716f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ae2bd7-ccbf-4441-b451-2ed060ef8056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ae2bd7-ccbf-4441-b451-2ed060ef8056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34959762-db2a-4b23-a996-3808c542c580', 'volume_name': 'volume-34959762-db2a-4b23-a996-3808c542c580', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6c3044-14ed-480e-8e85-a2b0c84b3573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6c3044-14ed-480e-8e85-a2b0c84b3573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32a5e39-8129-48aa-9773-dd253d419728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:36 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Volume 34959762-db2a-4b23-a996-3808c542c580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34959762-db2a-4b23-a996-3808c542c580', 'volume_size': 1} Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=115fa4e2-8440-4ee4-9cc7-c74e4c5160c7,created_at=2026-11-06T17:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-134135938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=115fa4e2-8440-4ee4-9cc7-c74e4c5160c7,host='devstack@QuobyteHD#QuobyteHD',id=34959762-db2a-4b23-a996-3808c542c580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247527fec6444689be5d6c7244811c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:36Z,use_quota=True,user_id='a515d7b36bbe4366a2fb353d42668256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dde898b-cc6a-440f-9334-9cebb3a2061a),volume_type_id=0dde898b-cc6a-440f-9334-9cebb3a2061a)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Creating volume 34959762-db2a-4b23-a996-3808c542c580 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:42:36 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:42:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-34959762-db2a-4b23-a996-3808c542c580 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:36 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-34959762-db2a-4b23-a996-3808c542c580 1073741824 Nov 06 18:42:36 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-63a85f29-79fa-402a-bbc1-9eec25b671d9 tempest-VolumesSnapshotListTestJSON-1305120745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:37 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-34959762-db2a-4b23-a996-3808c542c580 1073741824" returned: 0 in 0.669s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-34959762-db2a-4b23-a996-3808c542c580 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:37 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-34959762-db2a-4b23-a996-3808c542c580 Nov 06 18:42:37 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:37 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-34959762-db2a-4b23-a996-3808c542c580" returned: 0 in 0.296s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:42:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-63a85f29-79fa-402a-bbc1-9eec25b671d9 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.383s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-63a85f29-79fa-402a-bbc1-9eec25b671d9 tempest-VolumesSnapshotListTestJSON-1305120745 None] Creating offline snapshot 64ed8a12-56dc-4327-9de4-c4e426ea1f94 of volume 4749e7d2-adc4-4460-a044-d1ae545f3787 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:42:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32a5e39-8129-48aa-9773-dd253d419728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34959762-db2a-4b23-a996-3808c542c580', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d16638c-24a6-4b73-a5b4-8ad3b26dad39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:37 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acd92de-ed0a-4c22-bc66-49c653a5c0ce]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-63a85f29-79fa-402a-bbc1-9eec25b671d9 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:37 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Volume volume-34959762-db2a-4b23-a996-3808c542c580 (34959762-db2a-4b23-a996-3808c542c580): created successfully Nov 06 18:42:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d16638c-24a6-4b73-a5b4-8ad3b26dad39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Flow 'volume_create_manager' (5176cccb-68e4-4142-b1cc-ca6aa7383ac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:37 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-067fad70-8824-4160-88c3-f95e91278c0b tempest-GroupsTest-1241171573 None] Created volume successfully. Nov 06 18:42:37 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787 Nov 06 18:42:37 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:38 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-63a85f29-79fa-402a-bbc1-9eec25b671d9 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787" returned: 0 in 0.462s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-63a85f29-79fa-402a-bbc1-9eec25b671d9 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:38 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 1G Nov 06 18:42:38 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:38 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-63a85f29-79fa-402a-bbc1-9eec25b671d9 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 1G" returned: 0 in 0.504s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-63a85f29-79fa-402a-bbc1-9eec25b671d9 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4749e7d2-adc4-4460-a044-d1ae545f3787 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:38 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4749e7d2-adc4-4460-a044-d1ae545f3787 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 Nov 06 18:42:38 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:38 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-63a85f29-79fa-402a-bbc1-9eec25b671d9 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4749e7d2-adc4-4460-a044-d1ae545f3787 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94" returned: 0 in 0.356s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:38 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-63a85f29-79fa-402a-bbc1-9eec25b671d9 tempest-VolumesSnapshotListTestJSON-1305120745 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 is being set with open permissions: ugo+rw Nov 06 18:42:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-63a85f29-79fa-402a-bbc1-9eec25b671d9 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:39 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 Nov 06 18:42:39 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:39 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-63a85f29-79fa-402a-bbc1-9eec25b671d9 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94" returned: 0 in 0.383s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-63a85f29-79fa-402a-bbc1-9eec25b671d9 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:39 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.info Nov 06 18:42:39 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:39 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-63a85f29-79fa-402a-bbc1-9eec25b671d9 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.info" returned: 0 in 0.346s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:39 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-63a85f29-79fa-402a-bbc1-9eec25b671d9 tempest-VolumesSnapshotListTestJSON-1305120745 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.info is being set with open permissions: ugo+rw Nov 06 18:42:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-63a85f29-79fa-402a-bbc1-9eec25b671d9 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:39 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.info Nov 06 18:42:39 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Flow 'volume_create_manager' (0a091341-249d-4122-b934-ec2c9b9b3670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a96dd4f-b8d1-4a7a-83ec-6ad8851b7826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a96dd4f-b8d1-4a7a-83ec-6ad8851b7826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1437889325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=115fa4e2-8440-4ee4-9cc7-c74e4c5160c7,host='devstack@QuobyteHD#QuobyteHD',id=c74126df-004d-46da-8760-af14c7dab8d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247527fec6444689be5d6c7244811c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:40Z,use_quota=True,user_id='a515d7b36bbe4366a2fb353d42668256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dde898b-cc6a-440f-9334-9cebb3a2061a),volume_type_id=0dde898b-cc6a-440f-9334-9cebb3a2061a)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b285a6b2-b096-45e9-b67d-d54eaf7e8121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b285a6b2-b096-45e9-b67d-d54eaf7e8121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5804e504-321c-4cbb-8816-77f55b774497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5804e504-321c-4cbb-8816-77f55b774497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c74126df-004d-46da-8760-af14c7dab8d5', 'volume_name': 'volume-c74126df-004d-46da-8760-af14c7dab8d5', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5c173d-a6d5-48f8-9fa1-4f945368fee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5c173d-a6d5-48f8-9fa1-4f945368fee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9454883-02a9-487a-b05b-97a7c4d79104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:40 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Volume c74126df-004d-46da-8760-af14c7dab8d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c74126df-004d-46da-8760-af14c7dab8d5', 'volume_size': 1} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:40 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-63a85f29-79fa-402a-bbc1-9eec25b671d9 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.info" returned: 0 in 0.404s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-63a85f29-79fa-402a-bbc1-9eec25b671d9 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.593s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.056s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=115fa4e2-8440-4ee4-9cc7-c74e4c5160c7,created_at=2026-11-06T17:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1437889325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=115fa4e2-8440-4ee4-9cc7-c74e4c5160c7,host='devstack@QuobyteHD#QuobyteHD',id=c74126df-004d-46da-8760-af14c7dab8d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247527fec6444689be5d6c7244811c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:40Z,use_quota=True,user_id='a515d7b36bbe4366a2fb353d42668256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dde898b-cc6a-440f-9334-9cebb3a2061a),volume_type_id=0dde898b-cc6a-440f-9334-9cebb3a2061a)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Creating volume c74126df-004d-46da-8760-af14c7dab8d5 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:42:40 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c74126df-004d-46da-8760-af14c7dab8d5 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:40 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c74126df-004d-46da-8760-af14c7dab8d5 1073741824 Nov 06 18:42:40 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:40 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-63a85f29-79fa-402a-bbc1-9eec25b671d9 tempest-VolumesSnapshotListTestJSON-1305120745 None] Create snapshot completed successfully Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-babe020d-2e29-46f7-9b35-7a9fc458b499 tempest-VolumesSnapshotListTestJSON-1305120745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:40 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c74126df-004d-46da-8760-af14c7dab8d5 1073741824" returned: 0 in 0.567s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c74126df-004d-46da-8760-af14c7dab8d5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:40 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c74126df-004d-46da-8760-af14c7dab8d5 Nov 06 18:42:40 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:41 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c74126df-004d-46da-8760-af14c7dab8d5" returned: 0 in 0.277s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:42:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-babe020d-2e29-46f7-9b35-7a9fc458b499 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.403s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9454883-02a9-487a-b05b-97a7c4d79104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c74126df-004d-46da-8760-af14c7dab8d5', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb535395-4c9e-49ce-9085-83d8a0609f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-babe020d-2e29-46f7-9b35-7a9fc458b499 tempest-VolumesSnapshotListTestJSON-1305120745 None] Creating offline snapshot 7971109c-bcaf-446c-82d4-87e7d20f2420 of volume 4749e7d2-adc4-4460-a044-d1ae545f3787 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:42:41 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Volume volume-c74126df-004d-46da-8760-af14c7dab8d5 (c74126df-004d-46da-8760-af14c7dab8d5): created successfully Nov 06 18:42:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb535395-4c9e-49ce-9085-83d8a0609f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Flow 'volume_create_manager' (0a091341-249d-4122-b934-ec2c9b9b3670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:41 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[62007c04-6b31-48e9-81b3-064cb80bf892]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-babe020d-2e29-46f7-9b35-7a9fc458b499 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:41 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-968bed42-d4f1-4638-8986-db5d24a06044 tempest-GroupsTest-1241171573 None] Created volume successfully. Nov 06 18:42:41 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 Nov 06 18:42:41 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:41 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-babe020d-2e29-46f7-9b35-7a9fc458b499 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94" returned: 0 in 0.473s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-babe020d-2e29-46f7-9b35-7a9fc458b499 tempest-VolumesSnapshotListTestJSON-1305120745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4749e7d2-adc4-4460-a044-d1ae545f3787(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:42:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-babe020d-2e29-46f7-9b35-7a9fc458b499 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:41 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 1G Nov 06 18:42:41 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:42 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-babe020d-2e29-46f7-9b35-7a9fc458b499 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 1G" returned: 0 in 0.543s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-babe020d-2e29-46f7-9b35-7a9fc458b499 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:42 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 Nov 06 18:42:42 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:42 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-b7f0a990-bf46-4003-afef-ae3d4d92eb10 tempest-GroupsTest-1241171573 None] Update group completed successfully. Nov 06 18:42:42 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-babe020d-2e29-46f7-9b35-7a9fc458b499 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420" returned: 0 in 0.453s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:42 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-babe020d-2e29-46f7-9b35-7a9fc458b499 tempest-VolumesSnapshotListTestJSON-1305120745 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 is being set with open permissions: ugo+rw Nov 06 18:42:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-babe020d-2e29-46f7-9b35-7a9fc458b499 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:42 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 Nov 06 18:42:42 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:43 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-babe020d-2e29-46f7-9b35-7a9fc458b499 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420" returned: 0 in 0.285s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-babe020d-2e29-46f7-9b35-7a9fc458b499 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:43 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-babe020d-2e29-46f7-9b35-7a9fc458b499 tempest-VolumesSnapshotListTestJSON-1305120745 None] Create snapshot completed successfully Nov 06 18:42:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-60abbe10-73b4-431a-ab0a-e291b670d83f tempest-VolumesSnapshotListTestJSON-1305120745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-60abbe10-73b4-431a-ab0a-e291b670d83f tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-60abbe10-73b4-431a-ab0a-e291b670d83f tempest-VolumesSnapshotListTestJSON-1305120745 None] Creating offline snapshot dc5118ef-51a1-4af0-82f6-0e91f10c03de of volume 4749e7d2-adc4-4460-a044-d1ae545f3787 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:42:44 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcd2f60-6998-4c20-a832-c1fa6d31f7b5]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-60abbe10-73b4-431a-ab0a-e291b670d83f tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:44 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-4fac7000-b32c-4ed9-ab2a-f758824e102e tempest-GroupsTest-1241171573 None] Update group completed successfully. Nov 06 18:42:44 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 Nov 06 18:42:44 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:44 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-60abbe10-73b4-431a-ab0a-e291b670d83f tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420" returned: 0 in 0.450s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-60abbe10-73b4-431a-ab0a-e291b670d83f tempest-VolumesSnapshotListTestJSON-1305120745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4749e7d2-adc4-4460-a044-d1ae545f3787(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:42:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-60abbe10-73b4-431a-ab0a-e291b670d83f tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.dc5118ef-51a1-4af0-82f6-0e91f10c03de 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:44 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.dc5118ef-51a1-4af0-82f6-0e91f10c03de 1G Nov 06 18:42:44 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:45 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-60abbe10-73b4-431a-ab0a-e291b670d83f tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.dc5118ef-51a1-4af0-82f6-0e91f10c03de 1G" returned: 0 in 0.535s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-60abbe10-73b4-431a-ab0a-e291b670d83f tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.dc5118ef-51a1-4af0-82f6-0e91f10c03de {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:45 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.dc5118ef-51a1-4af0-82f6-0e91f10c03de Nov 06 18:42:45 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:45 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-60abbe10-73b4-431a-ab0a-e291b670d83f tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.dc5118ef-51a1-4af0-82f6-0e91f10c03de" returned: 0 in 0.326s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:45 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-60abbe10-73b4-431a-ab0a-e291b670d83f tempest-VolumesSnapshotListTestJSON-1305120745 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.dc5118ef-51a1-4af0-82f6-0e91f10c03de is being set with open permissions: ugo+rw Nov 06 18:42:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-60abbe10-73b4-431a-ab0a-e291b670d83f tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.dc5118ef-51a1-4af0-82f6-0e91f10c03de {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:45 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.dc5118ef-51a1-4af0-82f6-0e91f10c03de Nov 06 18:42:45 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:45 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-60abbe10-73b4-431a-ab0a-e291b670d83f tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.dc5118ef-51a1-4af0-82f6-0e91f10c03de" returned: 0 in 0.283s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-60abbe10-73b4-431a-ab0a-e291b670d83f tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.756s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Acquiring lock "cinder-quobyte-34959762-db2a-4b23-a996-3808c542c580" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Lock "cinder-quobyte-34959762-db2a-4b23-a996-3808c542c580" acquired by "delete_volume" :: waited 0.023s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:46 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-60abbe10-73b4-431a-ab0a-e291b670d83f tempest-VolumesSnapshotListTestJSON-1305120745 None] Create snapshot completed successfully Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[643cd15a-b5cd-496c-b018-9db8203e4595]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-34959762-db2a-4b23-a996-3808c542c580 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:46 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-34959762-db2a-4b23-a996-3808c542c580 Nov 06 18:42:46 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:46 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-34959762-db2a-4b23-a996-3808c542c580" returned: 0 in 0.389s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-34959762-db2a-4b23-a996-3808c542c580 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:46 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-34959762-db2a-4b23-a996-3808c542c580 Nov 06 18:42:46 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:46 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-34959762-db2a-4b23-a996-3808c542c580" returned: 0 in 0.281s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Lock "cinder-quobyte-34959762-db2a-4b23-a996-3808c542c580" released by "delete_volume" :: held 0.729s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Acquiring lock "cinder-quobyte-c74126df-004d-46da-8760-af14c7dab8d5" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Flow 'volume_create_manager' (aa4d68f9-a23d-49fb-90db-cf5d09909e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e96720-9f28-4763-aec7-d5283ecfd461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e96720-9f28-4763-aec7-d5283ecfd461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-85658172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76069ee4-56d5-4f8a-b1e8-86721880513b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c3e12a664140ca8b086cc833a072ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:47Z,use_quota=True,user_id='c7ba4fe4257848be803456d024138b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1575e16-7dc0-4ac3-9d0d-2cf185226c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1575e16-7dc0-4ac3-9d0d-2cf185226c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd43eacb-9435-4b15-bb7b-7e1436a9873a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd43eacb-9435-4b15-bb7b-7e1436a9873a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76069ee4-56d5-4f8a-b1e8-86721880513b', 'volume_name': 'volume-76069ee4-56d5-4f8a-b1e8-86721880513b', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12dc4000-850c-46a4-a51f-68b4e930ae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12dc4000-850c-46a4-a51f-68b4e930ae1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61705b3-f336-4813-a995-0699ce789446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:46 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Volume 76069ee4-56d5-4f8a-b1e8-86721880513b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76069ee4-56d5-4f8a-b1e8-86721880513b', 'volume_size': 1} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-85658172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76069ee4-56d5-4f8a-b1e8-86721880513b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c3e12a664140ca8b086cc833a072ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:42:47Z,use_quota=True,user_id='c7ba4fe4257848be803456d024138b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Creating volume 76069ee4-56d5-4f8a-b1e8-86721880513b {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:42:46 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-76069ee4-56d5-4f8a-b1e8-86721880513b 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Lock "cinder-quobyte-c74126df-004d-46da-8760-af14c7dab8d5" acquired by "delete_volume" :: waited 0.123s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:46 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-76069ee4-56d5-4f8a-b1e8-86721880513b 1073741824 Nov 06 18:42:46 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4fc496-b05e-4436-a732-a8daab767160]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c74126df-004d-46da-8760-af14c7dab8d5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:47 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c74126df-004d-46da-8760-af14c7dab8d5 Nov 06 18:42:47 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] Acquiring lock "cinder-dc5118ef-51a1-4af0-82f6-0e91f10c03de-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-dc5118ef-51a1-4af0-82f6-0e91f10c03de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] Acquiring lock "cinder-quobyte-4749e7d2-adc4-4460-a044-d1ae545f3787" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:47 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-quobyte-4749e7d2-adc4-4460-a044-d1ae545f3787" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] Acquiring lock "cinder-quobyte-dc5118ef-51a1-4af0-82f6-0e91f10c03de" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c74126df-004d-46da-8760-af14c7dab8d5" returned: 0 in 0.463s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c74126df-004d-46da-8760-af14c7dab8d5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:47 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-76069ee4-56d5-4f8a-b1e8-86721880513b 1073741824" returned: 0 in 0.539s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-quobyte-dc5118ef-51a1-4af0-82f6-0e91f10c03de" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] Deleting offline snapshot dc5118ef-51a1-4af0-82f6-0e91f10c03de of volume 4749e7d2-adc4-4460-a044-d1ae545f3787 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:42:47 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c74126df-004d-46da-8760-af14c7dab8d5 Nov 06 18:42:47 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] snapshot_file for this snap is: volume-4749e7d2-adc4-4460-a044-d1ae545f3787.dc5118ef-51a1-4af0-82f6-0e91f10c03de {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f7fbab-ea17-4efa-84c3-c726edd20775]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.dc5118ef-51a1-4af0-82f6-0e91f10c03de {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-76069ee4-56d5-4f8a-b1e8-86721880513b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:47 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-76069ee4-56d5-4f8a-b1e8-86721880513b Nov 06 18:42:47 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:47 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.dc5118ef-51a1-4af0-82f6-0e91f10c03de Nov 06 18:42:47 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:47 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c74126df-004d-46da-8760-af14c7dab8d5" returned: 0 in 0.303s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Lock "cinder-quobyte-c74126df-004d-46da-8760-af14c7dab8d5" released by "delete_volume" :: held 0.831s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:47 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-76069ee4-56d5-4f8a-b1e8-86721880513b" returned: 0 in 0.264s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61705b3-f336-4813-a995-0699ce789446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76069ee4-56d5-4f8a-b1e8-86721880513b', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09da5146-50a2-473e-9b34-fdc8137e87bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:47 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Volume volume-76069ee4-56d5-4f8a-b1e8-86721880513b (76069ee4-56d5-4f8a-b1e8-86721880513b): created successfully Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09da5146-50a2-473e-9b34-fdc8137e87bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Flow 'volume_create_manager' (aa4d68f9-a23d-49fb-90db-cf5d09909e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:47 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-3f24f276-dee2-425d-883b-fd49cd47c4b7 tempest-VolumeQuotasNegativeTestJSON-198219211 None] Created volume successfully. Nov 06 18:42:47 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Created reservations ['c68d5aad-3a2b-4c11-80e2-e7624b75ca10'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.dc5118ef-51a1-4af0-82f6-0e91f10c03de" returned: 0 in 0.386s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4749e7d2-adc4-4460-a044-d1ae545f3787(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[b944cab2-a82f-46e1-a944-17edf0f02b66]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:47 devstack cinder-volume[86794]: WARNING cinder.quota [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1760253425 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1760253425, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:42:47 devstack cinder-volume[86794]: WARNING cinder.quota [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1760253425 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1760253425, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:42:47 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Created reservations ['b2c3d0df-b557-4af0-a396-3e7723627be5', '7918d2f2-8552-4e13-874a-1edd72b34b82', '64d90f07-408e-4aab-a918-5e72a9c33ecc', '64c0744c-d0b1-4150-aef9-672d3e32b35f'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:47 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 Nov 06 18:42:47 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:48 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Created reservations ['e93ba2de-d5e6-4808-b7ed-e7ea392a0620', 'a34bd478-b2ca-48ab-885b-397551919c1c', '47e42af4-2d1b-4e72-a1de-197b03c8ee3b', 'c695e8c6-545a-410a-b931-8d190703c768'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:48 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:42:48 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:48 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420" returned: 0 in 0.387s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4749e7d2-adc4-4460-a044-d1ae545f3787(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:42:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.dc5118ef-51a1-4af0-82f6-0e91f10c03de {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:48 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.dc5118ef-51a1-4af0-82f6-0e91f10c03de Nov 06 18:42:48 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:48 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.291s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:48 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:42:48 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-f013b063-9c15-400a-8fd4-8132f4a972a1 tempest-GroupsTest-1241171573 None] Delete group completed successfully. Nov 06 18:42:48 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.dc5118ef-51a1-4af0-82f6-0e91f10c03de" returned: 0 in 0.471s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.dc5118ef-51a1-4af0-82f6-0e91f10c03de {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:48 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.dc5118ef-51a1-4af0-82f6-0e91f10c03de Nov 06 18:42:48 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:48 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.dc5118ef-51a1-4af0-82f6-0e91f10c03de" returned: 0 in 0.261s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-quobyte-dc5118ef-51a1-4af0-82f6-0e91f10c03de" released by "_delete_snapshot" :: held 1.613s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-quobyte-4749e7d2-adc4-4460-a044-d1ae545f3787" released by "delete_snapshot" :: held 1.651s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:49 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] Created reservations ['e11d059d-84e4-4f7f-95e7-3f13d92c8ee5', '4d575882-505a-4fb1-892e-3e8ea826a3ff', '888d2104-6d5a-4a2f-9935-97cfa1f83682', 'efa02e50-d65b-4a65-a141-87818a80cfa6'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:49 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] Delete snapshot completed successfully. Nov 06 18:42:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-762b27d9-f403-411b-a4f2-e1fc675e2812 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-dc5118ef-51a1-4af0-82f6-0e91f10c03de-delete_snapshot" released by "delete_snapshot" :: held 1.810s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] Acquiring lock "cinder-7971109c-bcaf-446c-82d4-87e7d20f2420-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-7971109c-bcaf-446c-82d4-87e7d20f2420-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] Acquiring lock "cinder-quobyte-4749e7d2-adc4-4460-a044-d1ae545f3787" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-quobyte-4749e7d2-adc4-4460-a044-d1ae545f3787" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] Acquiring lock "cinder-quobyte-7971109c-bcaf-446c-82d4-87e7d20f2420" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-quobyte-7971109c-bcaf-446c-82d4-87e7d20f2420" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:49 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] Deleting offline snapshot 7971109c-bcaf-446c-82d4-87e7d20f2420 of volume 4749e7d2-adc4-4460-a044-d1ae545f3787 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:42:49 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] snapshot_file for this snap is: volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:42:49 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9e6479-aea7-49ab-8873-5292f4784fea]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:49 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 Nov 06 18:42:49 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:50 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420" returned: 0 in 0.457s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:50 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4749e7d2-adc4-4460-a044-d1ae545f3787(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:42:50 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28bbe89-678b-4535-b83e-42ddf6ed9c63]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8f85fc6a-374d-4b7d-8f99-c9f105f9211f tempest-VolumeQuotasNegativeTestJSON-198219211 None] Acquiring lock "cinder-76069ee4-56d5-4f8a-b1e8-86721880513b-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8f85fc6a-374d-4b7d-8f99-c9f105f9211f tempest-VolumeQuotasNegativeTestJSON-198219211 None] Lock "cinder-76069ee4-56d5-4f8a-b1e8-86721880513b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8f85fc6a-374d-4b7d-8f99-c9f105f9211f tempest-VolumeQuotasNegativeTestJSON-198219211 None] Acquiring lock "cinder-quobyte-76069ee4-56d5-4f8a-b1e8-86721880513b" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8f85fc6a-374d-4b7d-8f99-c9f105f9211f tempest-VolumeQuotasNegativeTestJSON-198219211 None] Lock "cinder-quobyte-76069ee4-56d5-4f8a-b1e8-86721880513b" acquired by "delete_volume" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:50 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 Nov 06 18:42:50 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:50 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe18fed2-0ce8-45a2-aaec-1e1afc878037]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8f85fc6a-374d-4b7d-8f99-c9f105f9211f tempest-VolumeQuotasNegativeTestJSON-198219211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-76069ee4-56d5-4f8a-b1e8-86721880513b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:50 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-76069ee4-56d5-4f8a-b1e8-86721880513b Nov 06 18:42:50 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:50 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94" returned: 0 in 0.576s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:50 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4749e7d2-adc4-4460-a044-d1ae545f3787(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:42:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:50 devstack sudo[99019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 Nov 06 18:42:50 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:50 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8f85fc6a-374d-4b7d-8f99-c9f105f9211f tempest-VolumeQuotasNegativeTestJSON-198219211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-76069ee4-56d5-4f8a-b1e8-86721880513b" returned: 0 in 0.500s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8f85fc6a-374d-4b7d-8f99-c9f105f9211f tempest-VolumeQuotasNegativeTestJSON-198219211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-76069ee4-56d5-4f8a-b1e8-86721880513b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:50 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-76069ee4-56d5-4f8a-b1e8-86721880513b Nov 06 18:42:50 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:51 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8f85fc6a-374d-4b7d-8f99-c9f105f9211f tempest-VolumeQuotasNegativeTestJSON-198219211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-76069ee4-56d5-4f8a-b1e8-86721880513b" returned: 0 in 0.353s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:51 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8f85fc6a-374d-4b7d-8f99-c9f105f9211f tempest-VolumeQuotasNegativeTestJSON-198219211 None] Lock "cinder-quobyte-76069ee4-56d5-4f8a-b1e8-86721880513b" released by "delete_volume" :: held 0.925s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:51 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420" returned: 0 in 0.586s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:51 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-8f85fc6a-374d-4b7d-8f99-c9f105f9211f tempest-VolumeQuotasNegativeTestJSON-198219211 None] Created reservations ['6f0d107f-62e4-4d81-88c3-6d0720677a3d', 'b8eb1794-169c-4659-baf7-f5c4ff2f0426', 'daab8b21-ddec-4b8f-a1e6-d1292028e110', 'bda08dc3-b9c2-4220-b0f1-f5f2cc6bed84'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:51 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420 Nov 06 18:42:51 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8f85fc6a-374d-4b7d-8f99-c9f105f9211f tempest-VolumeQuotasNegativeTestJSON-198219211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8f85fc6a-374d-4b7d-8f99-c9f105f9211f tempest-VolumeQuotasNegativeTestJSON-198219211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:51 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8f85fc6a-374d-4b7d-8f99-c9f105f9211f tempest-VolumeQuotasNegativeTestJSON-198219211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:51 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8f85fc6a-374d-4b7d-8f99-c9f105f9211f tempest-VolumeQuotasNegativeTestJSON-198219211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8f85fc6a-374d-4b7d-8f99-c9f105f9211f tempest-VolumeQuotasNegativeTestJSON-198219211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8f85fc6a-374d-4b7d-8f99-c9f105f9211f tempest-VolumeQuotasNegativeTestJSON-198219211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:51 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:42:51 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:51 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.7971109c-bcaf-446c-82d4-87e7d20f2420" returned: 0 in 0.455s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:51 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-quobyte-7971109c-bcaf-446c-82d4-87e7d20f2420" released by "_delete_snapshot" :: held 2.219s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:51 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-quobyte-4749e7d2-adc4-4460-a044-d1ae545f3787" released by "delete_snapshot" :: held 2.248s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:51 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] Created reservations ['af317bd1-acf2-41a5-8474-9f9a22d70d25', '116a8469-5242-44e4-b764-c0642a386cf0', 'd914ab66-70aa-4bce-9b85-fdcf665d1c60', '5382f2f0-ba81-41be-8f4e-eac809222dfd'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:51 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8f85fc6a-374d-4b7d-8f99-c9f105f9211f tempest-VolumeQuotasNegativeTestJSON-198219211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.465s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:51 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-8f85fc6a-374d-4b7d-8f99-c9f105f9211f tempest-VolumeQuotasNegativeTestJSON-198219211 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:42:51 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-8f85fc6a-374d-4b7d-8f99-c9f105f9211f tempest-VolumeQuotasNegativeTestJSON-198219211 None] Deleted volume successfully. Nov 06 18:42:51 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8f85fc6a-374d-4b7d-8f99-c9f105f9211f tempest-VolumeQuotasNegativeTestJSON-198219211 None] Lock "cinder-76069ee4-56d5-4f8a-b1e8-86721880513b-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:51 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] Delete snapshot completed successfully. Nov 06 18:42:51 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3cdd0ba8-f278-4a70-91eb-5a8cc0a4f907 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-7971109c-bcaf-446c-82d4-87e7d20f2420-delete_snapshot" released by "delete_snapshot" :: held 2.487s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] Acquiring lock "cinder-64ed8a12-56dc-4327-9de4-c4e426ea1f94-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-64ed8a12-56dc-4327-9de4-c4e426ea1f94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] Acquiring lock "cinder-quobyte-4749e7d2-adc4-4460-a044-d1ae545f3787" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-quobyte-4749e7d2-adc4-4460-a044-d1ae545f3787" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] Acquiring lock "cinder-quobyte-64ed8a12-56dc-4327-9de4-c4e426ea1f94" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-quobyte-64ed8a12-56dc-4327-9de4-c4e426ea1f94" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] Deleting offline snapshot 64ed8a12-56dc-4327-9de4-c4e426ea1f94 of volume 4749e7d2-adc4-4460-a044-d1ae545f3787 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:42:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] snapshot_file for this snap is: volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:42:52 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d094f5-160b-4dcb-9169-b5b0fae046ea]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:52 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 Nov 06 18:42:52 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:53 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94" returned: 0 in 0.472s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4749e7d2-adc4-4460-a044-d1ae545f3787(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:42:53 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58e9d01-9726-4cfc-a262-42402cd15303]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:53 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787 Nov 06 18:42:53 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:53 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787" returned: 0 in 0.532s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:53 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 Nov 06 18:42:53 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:54 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94" returned: 0 in 0.448s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:54 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94 Nov 06 18:42:54 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:54 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787.64ed8a12-56dc-4327-9de4-c4e426ea1f94" returned: 0 in 0.360s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-quobyte-64ed8a12-56dc-4327-9de4-c4e426ea1f94" released by "_delete_snapshot" :: held 1.962s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-quobyte-4749e7d2-adc4-4460-a044-d1ae545f3787" released by "delete_snapshot" :: held 2.000s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:54 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] Created reservations ['63ae0a18-3a1f-4636-a9ab-1048da3c4373', '60e49c78-99b5-4de2-b374-27c6726fc073', '39fa024e-d4f7-4eef-8134-633c9d568aa6', '1833dab3-e5b2-4466-a5ff-86df239d7e83'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:54 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] Delete snapshot completed successfully. Nov 06 18:42:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-33473d91-d053-428f-80c9-44162e4eb895 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-64ed8a12-56dc-4327-9de4-c4e426ea1f94-delete_snapshot" released by "delete_snapshot" :: held 2.204s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:56 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-535d0e63-6795-4cd3-8045-63eab4a99740 tempest-VolumesSnapshotListTestJSON-1305120745 None] Acquiring lock "cinder-4749e7d2-adc4-4460-a044-d1ae545f3787-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:56 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-535d0e63-6795-4cd3-8045-63eab4a99740 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-4749e7d2-adc4-4460-a044-d1ae545f3787-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:56 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=158,cinder:UPDATE=187,cinder:INSERT=40,cinder:DELETE=11 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:42:56 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-535d0e63-6795-4cd3-8045-63eab4a99740 tempest-VolumesSnapshotListTestJSON-1305120745 None] Acquiring lock "cinder-quobyte-4749e7d2-adc4-4460-a044-d1ae545f3787" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:56 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-535d0e63-6795-4cd3-8045-63eab4a99740 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-quobyte-4749e7d2-adc4-4460-a044-d1ae545f3787" acquired by "delete_volume" :: waited 0.047s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:56 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce7299d-4ae7-4581-b99f-25f865d90475]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-535d0e63-6795-4cd3-8045-63eab4a99740 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:56 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c7dc58a9-ff6b-45b6-951a-a08fdfec96f9 tempest-GroupsV320Test-596535249 None] Group tempest-GroupsV320Test-Group-917842968: creating Nov 06 18:42:56 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c7dc58a9-ff6b-45b6-951a-a08fdfec96f9 tempest-GroupsV320Test-596535249 None] Group tempest-GroupsV320Test-Group-917842968: created successfully Nov 06 18:42:56 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c7dc58a9-ff6b-45b6-951a-a08fdfec96f9 tempest-GroupsV320Test-596535249 None] Create group completed successfully. Nov 06 18:42:56 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787 Nov 06 18:42:56 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:56 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-535d0e63-6795-4cd3-8045-63eab4a99740 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787" returned: 0 in 0.436s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-535d0e63-6795-4cd3-8045-63eab4a99740 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:56 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787 Nov 06 18:42:56 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:57 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-535d0e63-6795-4cd3-8045-63eab4a99740 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4749e7d2-adc4-4460-a044-d1ae545f3787" returned: 0 in 0.274s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:57 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-535d0e63-6795-4cd3-8045-63eab4a99740 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-quobyte-4749e7d2-adc4-4460-a044-d1ae545f3787" released by "delete_volume" :: held 0.824s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:57 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=159,cinder:UPDATE=184,cinder:DELETE=14,cinder:INSERT=44 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:42:57 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-535d0e63-6795-4cd3-8045-63eab4a99740 tempest-VolumesSnapshotListTestJSON-1305120745 None] Created reservations ['4169f329-55bd-46d6-a3e2-30cfafff9560', 'c12ff162-6922-4b87-a4d0-b95ff9ebb017', '90ddd2fd-b5c3-4364-be2e-638e9f09e7a2', 'ac655d01-f84c-472c-a630-8f001cf9fdc1'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-535d0e63-6795-4cd3-8045-63eab4a99740 tempest-VolumesSnapshotListTestJSON-1305120745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-535d0e63-6795-4cd3-8045-63eab4a99740 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:57 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-535d0e63-6795-4cd3-8045-63eab4a99740 tempest-VolumesSnapshotListTestJSON-1305120745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:57 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-535d0e63-6795-4cd3-8045-63eab4a99740 tempest-VolumesSnapshotListTestJSON-1305120745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-535d0e63-6795-4cd3-8045-63eab4a99740 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-535d0e63-6795-4cd3-8045-63eab4a99740 tempest-VolumesSnapshotListTestJSON-1305120745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:57 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:42:57 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:57 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-e47200a9-22de-4236-b738-86676cd1d511 req-486f2b7d-1230-421d-b78d-09c1f3088bee tempest-TestMinimumBasicScenario-678933044 None] Terminate volume connection completed successfully. Nov 06 18:42:57 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-e47200a9-22de-4236-b738-86676cd1d511 req-486f2b7d-1230-421d-b78d-09c1f3088bee tempest-TestMinimumBasicScenario-678933044 None] Deleting attachment 30ac37c0-75a7-459a-b637-1e454401b55a. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:42:57 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-535d0e63-6795-4cd3-8045-63eab4a99740 tempest-VolumesSnapshotListTestJSON-1305120745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.360s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:57 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-535d0e63-6795-4cd3-8045-63eab4a99740 tempest-VolumesSnapshotListTestJSON-1305120745 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:42:57 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-535d0e63-6795-4cd3-8045-63eab4a99740 tempest-VolumesSnapshotListTestJSON-1305120745 None] Deleted volume successfully. Nov 06 18:42:57 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-535d0e63-6795-4cd3-8045-63eab4a99740 tempest-VolumesSnapshotListTestJSON-1305120745 None] Lock "cinder-4749e7d2-adc4-4460-a044-d1ae545f3787-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:42:58 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-570c5ffc-0377-4328-b2d7-e165056f972a tempest-GroupsV320Test-596535249 None] Created reservations ['6e19f0ea-4699-4696-8ad1-3e10657b1661'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:42:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-570c5ffc-0377-4328-b2d7-e165056f972a tempest-GroupsV320Test-596535249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-570c5ffc-0377-4328-b2d7-e165056f972a tempest-GroupsV320Test-596535249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-570c5ffc-0377-4328-b2d7-e165056f972a tempest-GroupsV320Test-596535249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-570c5ffc-0377-4328-b2d7-e165056f972a tempest-GroupsV320Test-596535249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-570c5ffc-0377-4328-b2d7-e165056f972a tempest-GroupsV320Test-596535249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-570c5ffc-0377-4328-b2d7-e165056f972a tempest-GroupsV320Test-596535249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:58 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:42:58 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:58 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Nov 06 18:42:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-570c5ffc-0377-4328-b2d7-e165056f972a tempest-GroupsV320Test-596535249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.270s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:42:58 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-570c5ffc-0377-4328-b2d7-e165056f972a tempest-GroupsV320Test-596535249 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:42:58 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-570c5ffc-0377-4328-b2d7-e165056f972a tempest-GroupsV320Test-596535249 None] Delete group completed successfully. Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-607f9f4d-a8d0-4934-a4cd-5673e1d9ec1d tempest-TestMinimumBasicScenario-678933044 None] Acquiring lock "cinder-10dcd822-e6a5-4a8e-aeb0-0e190db68f64-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-607f9f4d-a8d0-4934-a4cd-5673e1d9ec1d tempest-TestMinimumBasicScenario-678933044 None] Lock "cinder-10dcd822-e6a5-4a8e-aeb0-0e190db68f64-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-607f9f4d-a8d0-4934-a4cd-5673e1d9ec1d tempest-TestMinimumBasicScenario-678933044 None] Acquiring lock "cinder-quobyte-10dcd822-e6a5-4a8e-aeb0-0e190db68f64" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-607f9f4d-a8d0-4934-a4cd-5673e1d9ec1d tempest-TestMinimumBasicScenario-678933044 None] Lock "cinder-quobyte-10dcd822-e6a5-4a8e-aeb0-0e190db68f64" acquired by "delete_volume" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6adfc08-d1a9-448e-89a0-c68ffe2cb947]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-607f9f4d-a8d0-4934-a4cd-5673e1d9ec1d tempest-TestMinimumBasicScenario-678933044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-10dcd822-e6a5-4a8e-aeb0-0e190db68f64 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Flow 'volume_create_manager' (56b6589e-8dae-4d40-aae4-2491d2d83dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92350e73-8ffc-4edb-a2d5-594881f7224e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:59 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-10dcd822-e6a5-4a8e-aeb0-0e190db68f64 Nov 06 18:42:59 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92350e73-8ffc-4edb-a2d5-594881f7224e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-691216379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de08bf04-3972-49ed-a27c-f1db6d01c39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094f71226da647718ee01b4de1eb0da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:43:00Z,use_quota=True,user_id='fce799396d5d4d9f8d171e2e7f8b82e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36ac12e-6ffa-43b1-82e9-1faeb877d654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36ac12e-6ffa-43b1-82e9-1faeb877d654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76148397-a7d8-4984-a5ab-fa411abfe297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76148397-a7d8-4984-a5ab-fa411abfe297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de08bf04-3972-49ed-a27c-f1db6d01c39c', 'volume_name': 'volume-de08bf04-3972-49ed-a27c-f1db6d01c39c', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eec5e68-2d09-4be3-8799-9d20520743fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eec5e68-2d09-4be3-8799-9d20520743fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56513c81-2e6a-4eae-be39-a005d2f22e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:42:59 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Volume de08bf04-3972-49ed-a27c-f1db6d01c39c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de08bf04-3972-49ed-a27c-f1db6d01c39c', 'volume_size': 1} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-691216379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de08bf04-3972-49ed-a27c-f1db6d01c39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094f71226da647718ee01b4de1eb0da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:43:00Z,use_quota=True,user_id='fce799396d5d4d9f8d171e2e7f8b82e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Creating volume de08bf04-3972-49ed-a27c-f1db6d01c39c {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:42:59 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:42:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de08bf04-3972-49ed-a27c-f1db6d01c39c 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:42:59 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de08bf04-3972-49ed-a27c-f1db6d01c39c 1073741824 Nov 06 18:42:59 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:00 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-607f9f4d-a8d0-4934-a4cd-5673e1d9ec1d tempest-TestMinimumBasicScenario-678933044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-10dcd822-e6a5-4a8e-aeb0-0e190db68f64" returned: 0 in 0.467s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-607f9f4d-a8d0-4934-a4cd-5673e1d9ec1d tempest-TestMinimumBasicScenario-678933044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-10dcd822-e6a5-4a8e-aeb0-0e190db68f64 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:00 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-10dcd822-e6a5-4a8e-aeb0-0e190db68f64 Nov 06 18:43:00 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:00 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de08bf04-3972-49ed-a27c-f1db6d01c39c 1073741824" returned: 0 in 0.638s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:00 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-607f9f4d-a8d0-4934-a4cd-5673e1d9ec1d tempest-TestMinimumBasicScenario-678933044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-10dcd822-e6a5-4a8e-aeb0-0e190db68f64" returned: 0 in 0.385s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:00 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-607f9f4d-a8d0-4934-a4cd-5673e1d9ec1d tempest-TestMinimumBasicScenario-678933044 None] Lock "cinder-quobyte-10dcd822-e6a5-4a8e-aeb0-0e190db68f64" released by "delete_volume" :: held 0.938s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de08bf04-3972-49ed-a27c-f1db6d01c39c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:00 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de08bf04-3972-49ed-a27c-f1db6d01c39c Nov 06 18:43:00 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:00 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-607f9f4d-a8d0-4934-a4cd-5673e1d9ec1d tempest-TestMinimumBasicScenario-678933044 None] Created reservations ['d09f4bba-d58b-495b-8cd1-b84a0aa93ad4', '2f547b07-4e61-4cd3-adff-987f93bd1090', '79cf51b4-bdc1-437b-91cc-01e4e159b1e3', '533673b3-0cb6-4279-8af3-878452619741'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:43:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-607f9f4d-a8d0-4934-a4cd-5673e1d9ec1d tempest-TestMinimumBasicScenario-678933044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-607f9f4d-a8d0-4934-a4cd-5673e1d9ec1d tempest-TestMinimumBasicScenario-678933044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-607f9f4d-a8d0-4934-a4cd-5673e1d9ec1d tempest-TestMinimumBasicScenario-678933044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:43:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-607f9f4d-a8d0-4934-a4cd-5673e1d9ec1d tempest-TestMinimumBasicScenario-678933044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:43:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-607f9f4d-a8d0-4934-a4cd-5673e1d9ec1d tempest-TestMinimumBasicScenario-678933044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-607f9f4d-a8d0-4934-a4cd-5673e1d9ec1d tempest-TestMinimumBasicScenario-678933044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:00 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:43:00 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:00 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de08bf04-3972-49ed-a27c-f1db6d01c39c" returned: 0 in 0.416s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:43:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56513c81-2e6a-4eae-be39-a005d2f22e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de08bf04-3972-49ed-a27c-f1db6d01c39c', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15006980-0b84-4190-a9f5-00bd1ee5dd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:01 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Volume volume-de08bf04-3972-49ed-a27c-f1db6d01c39c (de08bf04-3972-49ed-a27c-f1db6d01c39c): created successfully Nov 06 18:43:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15006980-0b84-4190-a9f5-00bd1ee5dd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Flow 'volume_create_manager' (56b6589e-8dae-4d40-aae4-2491d2d83dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:43:01 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-9a9b65f1-00ac-4cf6-88b8-51c4c311864b tempest-VolumesServicesTestJSON-350357102 None] Created volume successfully. Nov 06 18:43:01 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-607f9f4d-a8d0-4934-a4cd-5673e1d9ec1d tempest-TestMinimumBasicScenario-678933044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.367s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:01 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-607f9f4d-a8d0-4934-a4cd-5673e1d9ec1d tempest-TestMinimumBasicScenario-678933044 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:43:01 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-607f9f4d-a8d0-4934-a4cd-5673e1d9ec1d tempest-TestMinimumBasicScenario-678933044 None] Deleted volume successfully. Nov 06 18:43:01 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-607f9f4d-a8d0-4934-a4cd-5673e1d9ec1d tempest-TestMinimumBasicScenario-678933044 None] Lock "cinder-10dcd822-e6a5-4a8e-aeb0-0e190db68f64-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:02 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f95b5a7c-c46d-4c40-8ca8-92460db8aab9 tempest-VolumesServicesTestJSON-350357102 None] Acquiring lock "cinder-de08bf04-3972-49ed-a27c-f1db6d01c39c-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:02 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f95b5a7c-c46d-4c40-8ca8-92460db8aab9 tempest-VolumesServicesTestJSON-350357102 None] Lock "cinder-de08bf04-3972-49ed-a27c-f1db6d01c39c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:02 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f95b5a7c-c46d-4c40-8ca8-92460db8aab9 tempest-VolumesServicesTestJSON-350357102 None] Acquiring lock "cinder-quobyte-de08bf04-3972-49ed-a27c-f1db6d01c39c" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:02 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f95b5a7c-c46d-4c40-8ca8-92460db8aab9 tempest-VolumesServicesTestJSON-350357102 None] Lock "cinder-quobyte-de08bf04-3972-49ed-a27c-f1db6d01c39c" acquired by "delete_volume" :: waited 0.023s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:02 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fda1a7b-4578-4cd6-947a-34c208157ebf]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f95b5a7c-c46d-4c40-8ca8-92460db8aab9 tempest-VolumesServicesTestJSON-350357102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de08bf04-3972-49ed-a27c-f1db6d01c39c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:02 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de08bf04-3972-49ed-a27c-f1db6d01c39c Nov 06 18:43:02 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:02 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f95b5a7c-c46d-4c40-8ca8-92460db8aab9 tempest-VolumesServicesTestJSON-350357102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de08bf04-3972-49ed-a27c-f1db6d01c39c" returned: 0 in 0.520s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f95b5a7c-c46d-4c40-8ca8-92460db8aab9 tempest-VolumesServicesTestJSON-350357102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de08bf04-3972-49ed-a27c-f1db6d01c39c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:02 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de08bf04-3972-49ed-a27c-f1db6d01c39c Nov 06 18:43:02 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:03 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f95b5a7c-c46d-4c40-8ca8-92460db8aab9 tempest-VolumesServicesTestJSON-350357102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-de08bf04-3972-49ed-a27c-f1db6d01c39c" returned: 0 in 0.364s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f95b5a7c-c46d-4c40-8ca8-92460db8aab9 tempest-VolumesServicesTestJSON-350357102 None] Lock "cinder-quobyte-de08bf04-3972-49ed-a27c-f1db6d01c39c" released by "delete_volume" :: held 0.961s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:03 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-f95b5a7c-c46d-4c40-8ca8-92460db8aab9 tempest-VolumesServicesTestJSON-350357102 None] Created reservations ['73aed249-db4d-4c56-9cb8-9d8d47e9caee', 'a140e646-055f-422a-b7df-b4771d472dfe', 'e480d31b-3f1c-4b5f-b12b-80341929306d', '4da888d8-b739-4da7-ad9a-baaab2a8f45d'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:43:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f95b5a7c-c46d-4c40-8ca8-92460db8aab9 tempest-VolumesServicesTestJSON-350357102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f95b5a7c-c46d-4c40-8ca8-92460db8aab9 tempest-VolumesServicesTestJSON-350357102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f95b5a7c-c46d-4c40-8ca8-92460db8aab9 tempest-VolumesServicesTestJSON-350357102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:43:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f95b5a7c-c46d-4c40-8ca8-92460db8aab9 tempest-VolumesServicesTestJSON-350357102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:43:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f95b5a7c-c46d-4c40-8ca8-92460db8aab9 tempest-VolumesServicesTestJSON-350357102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f95b5a7c-c46d-4c40-8ca8-92460db8aab9 tempest-VolumesServicesTestJSON-350357102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:03 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:43:03 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:03 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f95b5a7c-c46d-4c40-8ca8-92460db8aab9 tempest-VolumesServicesTestJSON-350357102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.385s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:03 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-f95b5a7c-c46d-4c40-8ca8-92460db8aab9 tempest-VolumesServicesTestJSON-350357102 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:43:03 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-f95b5a7c-c46d-4c40-8ca8-92460db8aab9 tempest-VolumesServicesTestJSON-350357102 None] Deleted volume successfully. Nov 06 18:43:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f95b5a7c-c46d-4c40-8ca8-92460db8aab9 tempest-VolumesServicesTestJSON-350357102 None] Lock "cinder-de08bf04-3972-49ed-a27c-f1db6d01c39c-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Flow 'volume_create_manager' (eb264597-29b2-4137-a8b4-9defc2417a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684bba79-0674-46db-8ec1-2786a6eaab02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684bba79-0674-46db-8ec1-2786a6eaab02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1679759279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222036ea-6e0e-4418-badf-3b4bd78328d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='583aea3d25364c3bae63befcb6dc45b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:43:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:43:04Z,use_quota=True,user_id='6a0f00862ac24884a9045bbd0674968f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f50c584-94d6-48a1-99ad-9e1c5e1fea19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f50c584-94d6-48a1-99ad-9e1c5e1fea19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3252e4-06a4-4b0e-b39a-aefe87d2a67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3252e4-06a4-4b0e-b39a-aefe87d2a67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '222036ea-6e0e-4418-badf-3b4bd78328d9', 'volume_name': 'volume-222036ea-6e0e-4418-badf-3b4bd78328d9', 'volume_size': 2}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec32293f-5a75-456a-a1ad-87fa2a050d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec32293f-5a75-456a-a1ad-87fa2a050d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636d64d1-56cf-4c91-87a4-15afc01ec444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:04 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Volume 222036ea-6e0e-4418-badf-3b4bd78328d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-222036ea-6e0e-4418-badf-3b4bd78328d9', 'volume_size': 2} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1679759279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222036ea-6e0e-4418-badf-3b4bd78328d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='583aea3d25364c3bae63befcb6dc45b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:43:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:43:04Z,use_quota=True,user_id='6a0f00862ac24884a9045bbd0674968f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Creating volume 222036ea-6e0e-4418-badf-3b4bd78328d9 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:43:04 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:43:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9 2147483648 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:04 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9 2147483648 Nov 06 18:43:04 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:05 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9 2147483648" returned: 0 in 0.714s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:05 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9 Nov 06 18:43:05 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:05 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9" returned: 0 in 0.295s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:43:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636d64d1-56cf-4c91-87a4-15afc01ec444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-222036ea-6e0e-4418-badf-3b4bd78328d9', 'volume_size': 2}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702d3f54-7434-486a-9c23-f3a7bcb75704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:05 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Volume volume-222036ea-6e0e-4418-badf-3b4bd78328d9 (222036ea-6e0e-4418-badf-3b4bd78328d9): created successfully Nov 06 18:43:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702d3f54-7434-486a-9c23-f3a7bcb75704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Flow 'volume_create_manager' (eb264597-29b2-4137-a8b4-9defc2417a67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:43:05 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-45718bfd-4d10-4f1d-aaf1-7a6a83e670b9 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Created volume successfully. Nov 06 18:43:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bd4de44c-d570-464e-ad47-ad06212e2388 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bd4de44c-d570-464e-ad47-ad06212e2388 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-bd4de44c-d570-464e-ad47-ad06212e2388 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Creating offline snapshot dac4a045-720e-456b-8cd8-dfa085d67e41 of volume 222036ea-6e0e-4418-badf-3b4bd78328d9 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:43:06 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6033d61-7d10-4a8d-93b2-2c5bd7013b6d]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bd4de44c-d570-464e-ad47-ad06212e2388 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:07 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9 Nov 06 18:43:07 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:07 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bd4de44c-d570-464e-ad47-ad06212e2388 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9" returned: 0 in 0.626s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bd4de44c-d570-464e-ad47-ad06212e2388 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.dac4a045-720e-456b-8cd8-dfa085d67e41 2G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:07 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.dac4a045-720e-456b-8cd8-dfa085d67e41 2G Nov 06 18:43:07 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:08 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bd4de44c-d570-464e-ad47-ad06212e2388 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.dac4a045-720e-456b-8cd8-dfa085d67e41 2G" returned: 0 in 0.564s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bd4de44c-d570-464e-ad47-ad06212e2388 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-222036ea-6e0e-4418-badf-3b4bd78328d9 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.dac4a045-720e-456b-8cd8-dfa085d67e41 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:08 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-222036ea-6e0e-4418-badf-3b4bd78328d9 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.dac4a045-720e-456b-8cd8-dfa085d67e41 Nov 06 18:43:08 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:08 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:43:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Flow 'volume_create_manager' (ebe65092-8762-4210-9558-48d06976b493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:43:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bfc00a4-f953-425f-a358-05efb049f6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bfc00a4-f953-425f-a358-05efb049f6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1661612637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48769eae-62ad-4183-86b1-f37885cf18c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a083b4ad00424757814f4a21516cf40b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:43:08Z,use_quota=True,user_id='ebd10740ccf244d9bf9fff3b5f44aa12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116e21d4-8036-4280-9cec-5b203a3f3932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116e21d4-8036-4280-9cec-5b203a3f3932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea12296-270d-4a7a-bbc2-937cece9b7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea12296-270d-4a7a-bbc2-937cece9b7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48769eae-62ad-4183-86b1-f37885cf18c9', 'volume_name': 'volume-48769eae-62ad-4183-86b1-f37885cf18c9', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e779d3c-be4a-441f-8ce8-11e4089d4517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e779d3c-be4a-441f-8ce8-11e4089d4517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f403d4-448b-4687-9909-76a539336037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:08 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Volume 48769eae-62ad-4183-86b1-f37885cf18c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48769eae-62ad-4183-86b1-f37885cf18c9', 'volume_size': 1} Nov 06 18:43:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:08 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bd4de44c-d570-464e-ad47-ad06212e2388 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-222036ea-6e0e-4418-badf-3b4bd78328d9 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.dac4a045-720e-456b-8cd8-dfa085d67e41" returned: 0 in 0.341s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:08 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-bd4de44c-d570-464e-ad47-ad06212e2388 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.dac4a045-720e-456b-8cd8-dfa085d67e41 is being set with open permissions: ugo+rw Nov 06 18:43:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bd4de44c-d570-464e-ad47-ad06212e2388 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.dac4a045-720e-456b-8cd8-dfa085d67e41 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:08 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.dac4a045-720e-456b-8cd8-dfa085d67e41 Nov 06 18:43:08 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:08 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bd4de44c-d570-464e-ad47-ad06212e2388 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.dac4a045-720e-456b-8cd8-dfa085d67e41" returned: 0 in 0.257s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bd4de44c-d570-464e-ad47-ad06212e2388 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:08 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.info Nov 06 18:43:08 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:09 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bd4de44c-d570-464e-ad47-ad06212e2388 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.info" returned: 0 in 0.267s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:09 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-bd4de44c-d570-464e-ad47-ad06212e2388 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.info is being set with open permissions: ugo+rw Nov 06 18:43:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bd4de44c-d570-464e-ad47-ad06212e2388 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:09 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.info Nov 06 18:43:09 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:09 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bd4de44c-d570-464e-ad47-ad06212e2388 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.info" returned: 0 in 0.361s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bd4de44c-d570-464e-ad47-ad06212e2388 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.538s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.166s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1661612637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48769eae-62ad-4183-86b1-f37885cf18c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a083b4ad00424757814f4a21516cf40b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:43:08Z,use_quota=True,user_id='ebd10740ccf244d9bf9fff3b5f44aa12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:43:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Creating volume 48769eae-62ad-4183-86b1-f37885cf18c9 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:43:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:43:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:43:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:43:09 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:43:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:09 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-bd4de44c-d570-464e-ad47-ad06212e2388 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Create snapshot completed successfully Nov 06 18:43:09 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9 1073741824 Nov 06 18:43:09 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:09 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9 1073741824" returned: 0 in 0.515s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:10 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9 Nov 06 18:43:10 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Acquiring lock "cinder-dac4a045-720e-456b-8cd8-dfa085d67e41-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Lock "cinder-dac4a045-720e-456b-8cd8-dfa085d67e41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Acquiring lock "cinder-quobyte-222036ea-6e0e-4418-badf-3b4bd78328d9" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Lock "cinder-quobyte-222036ea-6e0e-4418-badf-3b4bd78328d9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Acquiring lock "cinder-quobyte-dac4a045-720e-456b-8cd8-dfa085d67e41" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Lock "cinder-quobyte-dac4a045-720e-456b-8cd8-dfa085d67e41" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Deleting offline snapshot dac4a045-720e-456b-8cd8-dfa085d67e41 of volume 222036ea-6e0e-4418-badf-3b4bd78328d9 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:43:10 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] snapshot_file for this snap is: volume-222036ea-6e0e-4418-badf-3b4bd78328d9.dac4a045-720e-456b-8cd8-dfa085d67e41 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9" returned: 0 in 0.360s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a2783f-4708-427d-9f34-daafe9e36ea9]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f403d4-448b-4687-9909-76a539336037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48769eae-62ad-4183-86b1-f37885cf18c9', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b4ccec-7984-40ba-bad2-ff666eb8fb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.dac4a045-720e-456b-8cd8-dfa085d67e41 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:10 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Volume volume-48769eae-62ad-4183-86b1-f37885cf18c9 (48769eae-62ad-4183-86b1-f37885cf18c9): created successfully Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b4ccec-7984-40ba-bad2-ff666eb8fb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Flow 'volume_create_manager' (ebe65092-8762-4210-9558-48d06976b493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:43:10 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-11d87943-4223-437c-8ca2-86354d1ca593 tempest-SnapshotsActionsTest-134024785 None] Created volume successfully. Nov 06 18:43:10 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.dac4a045-720e-456b-8cd8-dfa085d67e41 Nov 06 18:43:10 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:10 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.dac4a045-720e-456b-8cd8-dfa085d67e41" returned: 0 in 0.433s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-222036ea-6e0e-4418-badf-3b4bd78328d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de2e903-9d50-4865-bfe4-4f786f0b064a]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:11 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9 Nov 06 18:43:11 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:11 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9" returned: 0 in 0.462s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.dac4a045-720e-456b-8cd8-dfa085d67e41 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:11 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.dac4a045-720e-456b-8cd8-dfa085d67e41 Nov 06 18:43:11 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0f507562-747a-4c87-bd81-be6f9a2c5589 tempest-SnapshotsActionsTest-134024785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0f507562-747a-4c87-bd81-be6f9a2c5589 tempest-SnapshotsActionsTest-134024785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-0f507562-747a-4c87-bd81-be6f9a2c5589 tempest-SnapshotsActionsTest-134024785 None] Creating offline snapshot 8f395804-0d5b-49d4-97ac-28095f251d2a of volume 48769eae-62ad-4183-86b1-f37885cf18c9 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:43:11 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cc56ed-160d-4150-b08e-f91d5bbf5053]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0f507562-747a-4c87-bd81-be6f9a2c5589 tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:11 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9 Nov 06 18:43:11 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:11 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.dac4a045-720e-456b-8cd8-dfa085d67e41" returned: 0 in 0.476s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.dac4a045-720e-456b-8cd8-dfa085d67e41 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:11 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.dac4a045-720e-456b-8cd8-dfa085d67e41 Nov 06 18:43:11 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:12 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0f507562-747a-4c87-bd81-be6f9a2c5589 tempest-SnapshotsActionsTest-134024785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9" returned: 0 in 0.412s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0f507562-747a-4c87-bd81-be6f9a2c5589 tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:12 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a 1G Nov 06 18:43:12 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:12 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9.dac4a045-720e-456b-8cd8-dfa085d67e41" returned: 0 in 0.317s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:12 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Lock "cinder-quobyte-dac4a045-720e-456b-8cd8-dfa085d67e41" released by "_delete_snapshot" :: held 1.910s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:12 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Lock "cinder-quobyte-222036ea-6e0e-4418-badf-3b4bd78328d9" released by "delete_snapshot" :: held 1.952s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:12 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Created reservations ['2616bc88-3d44-41d6-889c-17ce367d5f18', '7d3ebf60-b9e3-4a80-b972-181e881c45c3', 'b3c698ac-f8fd-4cf9-8f93-e09c332c4499', '2164dac6-d48f-4b8c-ad4a-6d090986355f'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:43:12 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Delete snapshot completed successfully. Nov 06 18:43:12 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-445796cc-1902-48f6-a095-0641ba7b0a6b tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Lock "cinder-dac4a045-720e-456b-8cd8-dfa085d67e41-delete_snapshot" released by "delete_snapshot" :: held 2.157s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:12 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0f507562-747a-4c87-bd81-be6f9a2c5589 tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a 1G" returned: 0 in 0.577s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0f507562-747a-4c87-bd81-be6f9a2c5589 tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48769eae-62ad-4183-86b1-f37885cf18c9 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:12 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48769eae-62ad-4183-86b1-f37885cf18c9 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a Nov 06 18:43:12 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:12 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0f507562-747a-4c87-bd81-be6f9a2c5589 tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48769eae-62ad-4183-86b1-f37885cf18c9 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a" returned: 0 in 0.318s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:12 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-0f507562-747a-4c87-bd81-be6f9a2c5589 tempest-SnapshotsActionsTest-134024785 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a is being set with open permissions: ugo+rw Nov 06 18:43:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0f507562-747a-4c87-bd81-be6f9a2c5589 tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:13 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a Nov 06 18:43:13 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:13 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0f507562-747a-4c87-bd81-be6f9a2c5589 tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a" returned: 0 in 0.288s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0f507562-747a-4c87-bd81-be6f9a2c5589 tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:13 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.info Nov 06 18:43:13 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-26420a7c-5706-4fc5-880e-778266afec15 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Acquiring lock "cinder-222036ea-6e0e-4418-badf-3b4bd78328d9-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-26420a7c-5706-4fc5-880e-778266afec15 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Lock "cinder-222036ea-6e0e-4418-badf-3b4bd78328d9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-26420a7c-5706-4fc5-880e-778266afec15 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Acquiring lock "cinder-quobyte-222036ea-6e0e-4418-badf-3b4bd78328d9" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:13 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0f507562-747a-4c87-bd81-be6f9a2c5589 tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.info" returned: 0 in 0.408s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:13 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-0f507562-747a-4c87-bd81-be6f9a2c5589 tempest-SnapshotsActionsTest-134024785 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.info is being set with open permissions: ugo+rw Nov 06 18:43:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0f507562-747a-4c87-bd81-be6f9a2c5589 tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-26420a7c-5706-4fc5-880e-778266afec15 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Lock "cinder-quobyte-222036ea-6e0e-4418-badf-3b4bd78328d9" acquired by "delete_volume" :: waited 0.034s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:13 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.info Nov 06 18:43:13 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:13 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25a8d12-f79c-460b-a950-889f62144036]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-26420a7c-5706-4fc5-880e-778266afec15 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:13 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9 Nov 06 18:43:13 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:14 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0f507562-747a-4c87-bd81-be6f9a2c5589 tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.info" returned: 0 in 0.271s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0f507562-747a-4c87-bd81-be6f9a2c5589 tempest-SnapshotsActionsTest-134024785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.400s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:14 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-0f507562-747a-4c87-bd81-be6f9a2c5589 tempest-SnapshotsActionsTest-134024785 None] Create snapshot completed successfully Nov 06 18:43:14 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-26420a7c-5706-4fc5-880e-778266afec15 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9" returned: 0 in 0.422s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-26420a7c-5706-4fc5-880e-778266afec15 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:14 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9 Nov 06 18:43:14 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:14 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-26420a7c-5706-4fc5-880e-778266afec15 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-222036ea-6e0e-4418-badf-3b4bd78328d9" returned: 0 in 0.270s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:14 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-26420a7c-5706-4fc5-880e-778266afec15 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Lock "cinder-quobyte-222036ea-6e0e-4418-badf-3b4bd78328d9" released by "delete_volume" :: held 0.778s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:14 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-26420a7c-5706-4fc5-880e-778266afec15 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Created reservations ['7ee0b056-a094-41b9-aa44-c171e3eb42f3', '32c7fc96-d9d3-4018-8f7e-75a97912cf58', '8b130bf9-98fa-4525-b4ce-78f876973296', '6759248b-4863-405b-af32-46fc7ab56ee3'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:43:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-26420a7c-5706-4fc5-880e-778266afec15 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-26420a7c-5706-4fc5-880e-778266afec15 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-26420a7c-5706-4fc5-880e-778266afec15 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:43:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-26420a7c-5706-4fc5-880e-778266afec15 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:43:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-26420a7c-5706-4fc5-880e-778266afec15 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-26420a7c-5706-4fc5-880e-778266afec15 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:14 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:43:14 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:15 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-26420a7c-5706-4fc5-880e-778266afec15 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.364s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:15 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-26420a7c-5706-4fc5-880e-778266afec15 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:43:15 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-26420a7c-5706-4fc5-880e-778266afec15 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Deleted volume successfully. Nov 06 18:43:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-26420a7c-5706-4fc5-880e-778266afec15 tempest-VolumesSnapshotNegativeTestJSON-1297609254 None] Lock "cinder-222036ea-6e0e-4418-badf-3b4bd78328d9-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bba585ad-8918-4633-89c7-8434be6abfb3 tempest-SnapshotsActionsTest-134024785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bba585ad-8918-4633-89c7-8434be6abfb3 tempest-SnapshotsActionsTest-134024785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-bba585ad-8918-4633-89c7-8434be6abfb3 tempest-SnapshotsActionsTest-134024785 None] Creating offline snapshot a20bf17f-8de2-4648-87c8-af40bed0c32c of volume 48769eae-62ad-4183-86b1-f37885cf18c9 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:43:16 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[92094d21-0d13-4aa3-9f0b-de4b00cf1bb5]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bba585ad-8918-4633-89c7-8434be6abfb3 tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:16 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a Nov 06 18:43:16 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:16 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bba585ad-8918-4633-89c7-8434be6abfb3 tempest-SnapshotsActionsTest-134024785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a" returned: 0 in 0.481s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-bba585ad-8918-4633-89c7-8434be6abfb3 tempest-SnapshotsActionsTest-134024785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48769eae-62ad-4183-86b1-f37885cf18c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:43:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bba585ad-8918-4633-89c7-8434be6abfb3 tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.a20bf17f-8de2-4648-87c8-af40bed0c32c 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:16 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.a20bf17f-8de2-4648-87c8-af40bed0c32c 1G Nov 06 18:43:16 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:17 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bba585ad-8918-4633-89c7-8434be6abfb3 tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.a20bf17f-8de2-4648-87c8-af40bed0c32c 1G" returned: 0 in 0.596s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bba585ad-8918-4633-89c7-8434be6abfb3 tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.a20bf17f-8de2-4648-87c8-af40bed0c32c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:17 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.a20bf17f-8de2-4648-87c8-af40bed0c32c Nov 06 18:43:17 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:17 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bba585ad-8918-4633-89c7-8434be6abfb3 tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.a20bf17f-8de2-4648-87c8-af40bed0c32c" returned: 0 in 0.325s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:17 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-bba585ad-8918-4633-89c7-8434be6abfb3 tempest-SnapshotsActionsTest-134024785 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.a20bf17f-8de2-4648-87c8-af40bed0c32c is being set with open permissions: ugo+rw Nov 06 18:43:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bba585ad-8918-4633-89c7-8434be6abfb3 tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.a20bf17f-8de2-4648-87c8-af40bed0c32c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:17 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.a20bf17f-8de2-4648-87c8-af40bed0c32c Nov 06 18:43:17 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:17 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bba585ad-8918-4633-89c7-8434be6abfb3 tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.a20bf17f-8de2-4648-87c8-af40bed0c32c" returned: 0 in 0.382s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bba585ad-8918-4633-89c7-8434be6abfb3 tempest-SnapshotsActionsTest-134024785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.963s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:18 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-bba585ad-8918-4633-89c7-8434be6abfb3 tempest-SnapshotsActionsTest-134024785 None] Create snapshot completed successfully Nov 06 18:43:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] Acquiring lock "cinder-a20bf17f-8de2-4648-87c8-af40bed0c32c-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-a20bf17f-8de2-4648-87c8-af40bed0c32c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] Acquiring lock "cinder-quobyte-48769eae-62ad-4183-86b1-f37885cf18c9" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-quobyte-48769eae-62ad-4183-86b1-f37885cf18c9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] Acquiring lock "cinder-quobyte-a20bf17f-8de2-4648-87c8-af40bed0c32c" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-quobyte-a20bf17f-8de2-4648-87c8-af40bed0c32c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] Deleting offline snapshot a20bf17f-8de2-4648-87c8-af40bed0c32c of volume 48769eae-62ad-4183-86b1-f37885cf18c9 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:43:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] snapshot_file for this snap is: volume-48769eae-62ad-4183-86b1-f37885cf18c9.a20bf17f-8de2-4648-87c8-af40bed0c32c {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:43:19 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[d529a551-fb97-4f4f-920d-19e28fe69177]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.a20bf17f-8de2-4648-87c8-af40bed0c32c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:19 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.a20bf17f-8de2-4648-87c8-af40bed0c32c Nov 06 18:43:19 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:19 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.a20bf17f-8de2-4648-87c8-af40bed0c32c" returned: 0 in 0.467s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48769eae-62ad-4183-86b1-f37885cf18c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:43:19 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[8632bdd9-83f9-4fda-8c82-2d07cf6502cb]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:20 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a Nov 06 18:43:20 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:20 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a" returned: 0 in 0.476s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48769eae-62ad-4183-86b1-f37885cf18c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:43:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.a20bf17f-8de2-4648-87c8-af40bed0c32c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:20 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.a20bf17f-8de2-4648-87c8-af40bed0c32c Nov 06 18:43:20 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:20 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.a20bf17f-8de2-4648-87c8-af40bed0c32c" returned: 0 in 0.517s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.a20bf17f-8de2-4648-87c8-af40bed0c32c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:20 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.a20bf17f-8de2-4648-87c8-af40bed0c32c Nov 06 18:43:20 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:21 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.a20bf17f-8de2-4648-87c8-af40bed0c32c" returned: 0 in 0.359s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-quobyte-a20bf17f-8de2-4648-87c8-af40bed0c32c" released by "_delete_snapshot" :: held 1.970s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-quobyte-48769eae-62ad-4183-86b1-f37885cf18c9" released by "delete_snapshot" :: held 1.995s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:21 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] Created reservations ['b5eca0bc-2d89-4514-8be7-29345161f417', '0c0aa968-a3fd-4707-b484-78bfa1548fad', 'c22b6471-9f7d-4e05-ba82-97d10019a76d', '10029f7f-0e70-4b94-8414-39fa20c2a247'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:43:21 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] Delete snapshot completed successfully. Nov 06 18:43:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b983add5-33fe-42e3-bce0-939498254603 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-a20bf17f-8de2-4648-87c8-af40bed0c32c-delete_snapshot" released by "delete_snapshot" :: held 2.181s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4d812790-1686-43f1-8e80-c7c1cc06f023 tempest-SnapshotsActionsTest-134024785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4d812790-1686-43f1-8e80-c7c1cc06f023 tempest-SnapshotsActionsTest-134024785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:22 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-4d812790-1686-43f1-8e80-c7c1cc06f023 tempest-SnapshotsActionsTest-134024785 None] Creating offline snapshot dbcce315-80f7-4f00-9c04-3f416ae25a70 of volume 48769eae-62ad-4183-86b1-f37885cf18c9 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:43:23 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d724c16-e63a-4970-953a-12ea7a68c588]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4d812790-1686-43f1-8e80-c7c1cc06f023 tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:23 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a Nov 06 18:43:23 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:23 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4d812790-1686-43f1-8e80-c7c1cc06f023 tempest-SnapshotsActionsTest-134024785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a" returned: 0 in 0.431s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-4d812790-1686-43f1-8e80-c7c1cc06f023 tempest-SnapshotsActionsTest-134024785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48769eae-62ad-4183-86b1-f37885cf18c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:43:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4d812790-1686-43f1-8e80-c7c1cc06f023 tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.dbcce315-80f7-4f00-9c04-3f416ae25a70 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:23 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.dbcce315-80f7-4f00-9c04-3f416ae25a70 1G Nov 06 18:43:23 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:24 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4d812790-1686-43f1-8e80-c7c1cc06f023 tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.dbcce315-80f7-4f00-9c04-3f416ae25a70 1G" returned: 0 in 0.696s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4d812790-1686-43f1-8e80-c7c1cc06f023 tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.dbcce315-80f7-4f00-9c04-3f416ae25a70 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:24 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.dbcce315-80f7-4f00-9c04-3f416ae25a70 Nov 06 18:43:24 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:24 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4d812790-1686-43f1-8e80-c7c1cc06f023 tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.dbcce315-80f7-4f00-9c04-3f416ae25a70" returned: 0 in 0.364s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:24 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-4d812790-1686-43f1-8e80-c7c1cc06f023 tempest-SnapshotsActionsTest-134024785 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.dbcce315-80f7-4f00-9c04-3f416ae25a70 is being set with open permissions: ugo+rw Nov 06 18:43:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4d812790-1686-43f1-8e80-c7c1cc06f023 tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.dbcce315-80f7-4f00-9c04-3f416ae25a70 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:24 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.dbcce315-80f7-4f00-9c04-3f416ae25a70 Nov 06 18:43:24 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:24 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4d812790-1686-43f1-8e80-c7c1cc06f023 tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.dbcce315-80f7-4f00-9c04-3f416ae25a70" returned: 0 in 0.293s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4d812790-1686-43f1-8e80-c7c1cc06f023 tempest-SnapshotsActionsTest-134024785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:24 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-4d812790-1686-43f1-8e80-c7c1cc06f023 tempest-SnapshotsActionsTest-134024785 None] Create snapshot completed successfully Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] Acquiring lock "cinder-dbcce315-80f7-4f00-9c04-3f416ae25a70-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-dbcce315-80f7-4f00-9c04-3f416ae25a70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] Acquiring lock "cinder-quobyte-48769eae-62ad-4183-86b1-f37885cf18c9" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-quobyte-48769eae-62ad-4183-86b1-f37885cf18c9" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] Acquiring lock "cinder-quobyte-dbcce315-80f7-4f00-9c04-3f416ae25a70" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-quobyte-dbcce315-80f7-4f00-9c04-3f416ae25a70" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] Deleting offline snapshot dbcce315-80f7-4f00-9c04-3f416ae25a70 of volume 48769eae-62ad-4183-86b1-f37885cf18c9 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] snapshot_file for this snap is: volume-48769eae-62ad-4183-86b1-f37885cf18c9.dbcce315-80f7-4f00-9c04-3f416ae25a70 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a13cfc6-8bb7-40d8-b0aa-01df9e94dc4c]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.dbcce315-80f7-4f00-9c04-3f416ae25a70 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Flow 'volume_create_manager' (da1e4c1d-73bd-4776-ba06-957128a21604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a19806-13fc-4419-b498-a339a5869bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a19806-13fc-4419-b498-a339a5869bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1030952769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=099c72af-eece-40e2-b82b-8480527f4511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ffc91c5a28445c9f6b3d7ad59ff977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:43:25Z,use_quota=True,user_id='197b60b3be0148cf9392adf1de934d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f011e3df-33f7-486e-b619-b99ca2d61669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f011e3df-33f7-486e-b619-b99ca2d61669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b65e8e-9c76-469c-911b-ac851bea8b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b65e8e-9c76-469c-911b-ac851bea8b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '099c72af-eece-40e2-b82b-8480527f4511', 'volume_name': 'volume-099c72af-eece-40e2-b82b-8480527f4511', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cefd51b-80f2-465b-bafb-b80c1c77f847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cefd51b-80f2-465b-bafb-b80c1c77f847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8036383c-5ca3-4ef7-af1d-9ab05b39d08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:25 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Volume 099c72af-eece-40e2-b82b-8480527f4511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-099c72af-eece-40e2-b82b-8480527f4511', 'volume_size': 1} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1030952769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=099c72af-eece-40e2-b82b-8480527f4511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ffc91c5a28445c9f6b3d7ad59ff977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:43:25Z,use_quota=True,user_id='197b60b3be0148cf9392adf1de934d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Creating volume 099c72af-eece-40e2-b82b-8480527f4511 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:43:25 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:43:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-099c72af-eece-40e2-b82b-8480527f4511 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:25 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.dbcce315-80f7-4f00-9c04-3f416ae25a70 Nov 06 18:43:25 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:25 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-099c72af-eece-40e2-b82b-8480527f4511 1073741824 Nov 06 18:43:25 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:26 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.dbcce315-80f7-4f00-9c04-3f416ae25a70" returned: 0 in 0.648s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:26 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48769eae-62ad-4183-86b1-f37885cf18c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:43:26 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e3a8f5-c6cb-4c64-9593-197485d2a363]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:26 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-099c72af-eece-40e2-b82b-8480527f4511 1073741824" returned: 0 in 0.678s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:26 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a Nov 06 18:43:26 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-099c72af-eece-40e2-b82b-8480527f4511 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:26 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-099c72af-eece-40e2-b82b-8480527f4511 Nov 06 18:43:26 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:26 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a" returned: 0 in 0.516s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:26 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48769eae-62ad-4183-86b1-f37885cf18c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:43:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.dbcce315-80f7-4f00-9c04-3f416ae25a70 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:26 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-099c72af-eece-40e2-b82b-8480527f4511" returned: 0 in 0.357s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:26 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:43:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:26 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.dbcce315-80f7-4f00-9c04-3f416ae25a70 Nov 06 18:43:26 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8036383c-5ca3-4ef7-af1d-9ab05b39d08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-099c72af-eece-40e2-b82b-8480527f4511', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4b5623-0cea-4192-85d0-441b5783e60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:26 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Volume volume-099c72af-eece-40e2-b82b-8480527f4511 (099c72af-eece-40e2-b82b-8480527f4511): created successfully Nov 06 18:43:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4b5623-0cea-4192-85d0-441b5783e60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Flow 'volume_create_manager' (da1e4c1d-73bd-4776-ba06-957128a21604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:43:26 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-085bcbe9-d2e6-407e-94eb-d7c04741ea32 tempest-AbsoluteLimitsTests-2026744708 None] Created volume successfully. Nov 06 18:43:27 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.dbcce315-80f7-4f00-9c04-3f416ae25a70" returned: 0 in 0.484s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.dbcce315-80f7-4f00-9c04-3f416ae25a70 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:27 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.dbcce315-80f7-4f00-9c04-3f416ae25a70 Nov 06 18:43:27 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:27 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.dbcce315-80f7-4f00-9c04-3f416ae25a70" returned: 0 in 0.303s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-quobyte-dbcce315-80f7-4f00-9c04-3f416ae25a70" released by "_delete_snapshot" :: held 2.114s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-quobyte-48769eae-62ad-4183-86b1-f37885cf18c9" released by "delete_snapshot" :: held 2.155s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:27 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] Created reservations ['c9a0cf0a-f41e-4204-8c2a-0473e240782d', '465a5f48-3fd2-46db-b89a-93ef70acc6b6', '7e85177d-df9f-4752-8e64-4fb38a1011a4', '40ab5ee8-ab63-4a03-8817-2c1342317bf8'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:43:27 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] Delete snapshot completed successfully. Nov 06 18:43:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ed0cc58a-32eb-4715-989a-b5eb54c86b99 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-dbcce315-80f7-4f00-9c04-3f416ae25a70-delete_snapshot" released by "delete_snapshot" :: held 2.370s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ef3354a6-5e71-4eea-91f2-77509c9af83f tempest-AbsoluteLimitsTests-2026744708 None] Acquiring lock "cinder-099c72af-eece-40e2-b82b-8480527f4511-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ef3354a6-5e71-4eea-91f2-77509c9af83f tempest-AbsoluteLimitsTests-2026744708 None] Lock "cinder-099c72af-eece-40e2-b82b-8480527f4511-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ef3354a6-5e71-4eea-91f2-77509c9af83f tempest-AbsoluteLimitsTests-2026744708 None] Acquiring lock "cinder-quobyte-099c72af-eece-40e2-b82b-8480527f4511" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ef3354a6-5e71-4eea-91f2-77509c9af83f tempest-AbsoluteLimitsTests-2026744708 None] Lock "cinder-quobyte-099c72af-eece-40e2-b82b-8480527f4511" acquired by "delete_volume" :: waited 0.018s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:27 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81cb7e6-dfbc-40c6-9178-591766b01e57]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ef3354a6-5e71-4eea-91f2-77509c9af83f tempest-AbsoluteLimitsTests-2026744708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-099c72af-eece-40e2-b82b-8480527f4511 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:28 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-099c72af-eece-40e2-b82b-8480527f4511 Nov 06 18:43:28 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:28 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ef3354a6-5e71-4eea-91f2-77509c9af83f tempest-AbsoluteLimitsTests-2026744708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-099c72af-eece-40e2-b82b-8480527f4511" returned: 0 in 0.418s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ef3354a6-5e71-4eea-91f2-77509c9af83f tempest-AbsoluteLimitsTests-2026744708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-099c72af-eece-40e2-b82b-8480527f4511 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:28 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-099c72af-eece-40e2-b82b-8480527f4511 Nov 06 18:43:28 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:28 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ef3354a6-5e71-4eea-91f2-77509c9af83f tempest-AbsoluteLimitsTests-2026744708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-099c72af-eece-40e2-b82b-8480527f4511" returned: 0 in 0.360s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:28 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ef3354a6-5e71-4eea-91f2-77509c9af83f tempest-AbsoluteLimitsTests-2026744708 None] Lock "cinder-quobyte-099c72af-eece-40e2-b82b-8480527f4511" released by "delete_volume" :: held 0.838s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:28 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-ef3354a6-5e71-4eea-91f2-77509c9af83f tempest-AbsoluteLimitsTests-2026744708 None] Created reservations ['568c5205-cfeb-4fbb-82c2-d057051092c8', '5873c5be-391d-4ddb-8029-57dd43c442a8', '69e12fb3-51df-4b64-a9b6-93ad13b8ab97', '7dcd78a6-6816-4c80-858d-6d4429cc1841'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:43:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1d60e925-d4cf-4be4-b8fc-b6f27bdf5f3b tempest-SnapshotsActionsTest-134024785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1d60e925-d4cf-4be4-b8fc-b6f27bdf5f3b tempest-SnapshotsActionsTest-134024785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-1d60e925-d4cf-4be4-b8fc-b6f27bdf5f3b tempest-SnapshotsActionsTest-134024785 None] Creating offline snapshot c3157d94-8e64-4c63-8f57-420b9c3bbc11 of volume 48769eae-62ad-4183-86b1-f37885cf18c9 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:43:28 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[884332e9-613a-4266-8e7e-d5c398df0c11]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1d60e925-d4cf-4be4-b8fc-b6f27bdf5f3b tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ef3354a6-5e71-4eea-91f2-77509c9af83f tempest-AbsoluteLimitsTests-2026744708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ef3354a6-5e71-4eea-91f2-77509c9af83f tempest-AbsoluteLimitsTests-2026744708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ef3354a6-5e71-4eea-91f2-77509c9af83f tempest-AbsoluteLimitsTests-2026744708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:43:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ef3354a6-5e71-4eea-91f2-77509c9af83f tempest-AbsoluteLimitsTests-2026744708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:43:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ef3354a6-5e71-4eea-91f2-77509c9af83f tempest-AbsoluteLimitsTests-2026744708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ef3354a6-5e71-4eea-91f2-77509c9af83f tempest-AbsoluteLimitsTests-2026744708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:29 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:43:29 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:43:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 29 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:43:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:43:29 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a Nov 06 18:43:29 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:29 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ef3354a6-5e71-4eea-91f2-77509c9af83f tempest-AbsoluteLimitsTests-2026744708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.601s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-ef3354a6-5e71-4eea-91f2-77509c9af83f tempest-AbsoluteLimitsTests-2026744708 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:43:29 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-ef3354a6-5e71-4eea-91f2-77509c9af83f tempest-AbsoluteLimitsTests-2026744708 None] Deleted volume successfully. Nov 06 18:43:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ef3354a6-5e71-4eea-91f2-77509c9af83f tempest-AbsoluteLimitsTests-2026744708 None] Lock "cinder-099c72af-eece-40e2-b82b-8480527f4511-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:29 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1d60e925-d4cf-4be4-b8fc-b6f27bdf5f3b tempest-SnapshotsActionsTest-134024785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a" returned: 0 in 0.750s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-1d60e925-d4cf-4be4-b8fc-b6f27bdf5f3b tempest-SnapshotsActionsTest-134024785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48769eae-62ad-4183-86b1-f37885cf18c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:43:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1d60e925-d4cf-4be4-b8fc-b6f27bdf5f3b tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.c3157d94-8e64-4c63-8f57-420b9c3bbc11 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:29 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.c3157d94-8e64-4c63-8f57-420b9c3bbc11 1G Nov 06 18:43:29 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:30 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1d60e925-d4cf-4be4-b8fc-b6f27bdf5f3b tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.c3157d94-8e64-4c63-8f57-420b9c3bbc11 1G" returned: 0 in 0.637s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1d60e925-d4cf-4be4-b8fc-b6f27bdf5f3b tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.c3157d94-8e64-4c63-8f57-420b9c3bbc11 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:30 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.c3157d94-8e64-4c63-8f57-420b9c3bbc11 Nov 06 18:43:30 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:30 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1d60e925-d4cf-4be4-b8fc-b6f27bdf5f3b tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.c3157d94-8e64-4c63-8f57-420b9c3bbc11" returned: 0 in 0.380s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:30 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-1d60e925-d4cf-4be4-b8fc-b6f27bdf5f3b tempest-SnapshotsActionsTest-134024785 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.c3157d94-8e64-4c63-8f57-420b9c3bbc11 is being set with open permissions: ugo+rw Nov 06 18:43:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1d60e925-d4cf-4be4-b8fc-b6f27bdf5f3b tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.c3157d94-8e64-4c63-8f57-420b9c3bbc11 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:30 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.c3157d94-8e64-4c63-8f57-420b9c3bbc11 Nov 06 18:43:30 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:30 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1d60e925-d4cf-4be4-b8fc-b6f27bdf5f3b tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.c3157d94-8e64-4c63-8f57-420b9c3bbc11" returned: 0 in 0.251s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1d60e925-d4cf-4be4-b8fc-b6f27bdf5f3b tempest-SnapshotsActionsTest-134024785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.159s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:31 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-1d60e925-d4cf-4be4-b8fc-b6f27bdf5f3b tempest-SnapshotsActionsTest-134024785 None] Create snapshot completed successfully Nov 06 18:43:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] Acquiring lock "cinder-c3157d94-8e64-4c63-8f57-420b9c3bbc11-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-c3157d94-8e64-4c63-8f57-420b9c3bbc11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] Acquiring lock "cinder-quobyte-48769eae-62ad-4183-86b1-f37885cf18c9" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-quobyte-48769eae-62ad-4183-86b1-f37885cf18c9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] Acquiring lock "cinder-quobyte-c3157d94-8e64-4c63-8f57-420b9c3bbc11" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-quobyte-c3157d94-8e64-4c63-8f57-420b9c3bbc11" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:32 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] Deleting offline snapshot c3157d94-8e64-4c63-8f57-420b9c3bbc11 of volume 48769eae-62ad-4183-86b1-f37885cf18c9 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:43:32 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] snapshot_file for this snap is: volume-48769eae-62ad-4183-86b1-f37885cf18c9.c3157d94-8e64-4c63-8f57-420b9c3bbc11 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:43:32 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cf80bb-0d46-45d8-8ed7-afeedcdc0b34]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.c3157d94-8e64-4c63-8f57-420b9c3bbc11 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:32 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.c3157d94-8e64-4c63-8f57-420b9c3bbc11 Nov 06 18:43:32 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:32 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.c3157d94-8e64-4c63-8f57-420b9c3bbc11" returned: 0 in 0.404s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:32 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48769eae-62ad-4183-86b1-f37885cf18c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:43:32 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[c226b7d7-3a02-4612-8e23-37184afa2cca]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:32 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a Nov 06 18:43:32 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:33 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a" returned: 0 in 0.404s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48769eae-62ad-4183-86b1-f37885cf18c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:43:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.c3157d94-8e64-4c63-8f57-420b9c3bbc11 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:33 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.c3157d94-8e64-4c63-8f57-420b9c3bbc11 Nov 06 18:43:33 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:33 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.c3157d94-8e64-4c63-8f57-420b9c3bbc11" returned: 0 in 0.513s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.c3157d94-8e64-4c63-8f57-420b9c3bbc11 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:33 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.c3157d94-8e64-4c63-8f57-420b9c3bbc11 Nov 06 18:43:33 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:33 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.c3157d94-8e64-4c63-8f57-420b9c3bbc11" returned: 0 in 0.276s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:33 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-quobyte-c3157d94-8e64-4c63-8f57-420b9c3bbc11" released by "_delete_snapshot" :: held 1.727s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:33 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-quobyte-48769eae-62ad-4183-86b1-f37885cf18c9" released by "delete_snapshot" :: held 1.770s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:34 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] Created reservations ['b2ec2ce3-77da-4070-9bc5-730b5c5dfc2c', '88853146-0a57-4dbd-a94b-b8de8d9e5974', 'a39e487c-cd86-41d3-a715-52ab7f99a895', '7795ad0e-c26b-40c7-9b57-c9954822dc46'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:43:34 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] Delete snapshot completed successfully. Nov 06 18:43:34 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1298e41e-1d8c-4249-a267-19971e4c98c3 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-c3157d94-8e64-4c63-8f57-420b9c3bbc11-delete_snapshot" released by "delete_snapshot" :: held 1.959s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f015fec8-24f3-42f2-9e36-92b0656e7490 tempest-SnapshotsActionsTest-134024785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f015fec8-24f3-42f2-9e36-92b0656e7490 tempest-SnapshotsActionsTest-134024785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-f015fec8-24f3-42f2-9e36-92b0656e7490 tempest-SnapshotsActionsTest-134024785 None] Creating offline snapshot 6605b9fa-31cd-4399-9dc1-cbc75ef2d532 of volume 48769eae-62ad-4183-86b1-f37885cf18c9 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:43:34 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[2112f5f9-a9c5-406c-8911-9cca4b84cdde]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f015fec8-24f3-42f2-9e36-92b0656e7490 tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:35 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a Nov 06 18:43:35 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:35 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f015fec8-24f3-42f2-9e36-92b0656e7490 tempest-SnapshotsActionsTest-134024785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a" returned: 0 in 0.504s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-f015fec8-24f3-42f2-9e36-92b0656e7490 tempest-SnapshotsActionsTest-134024785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48769eae-62ad-4183-86b1-f37885cf18c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:43:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f015fec8-24f3-42f2-9e36-92b0656e7490 tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.6605b9fa-31cd-4399-9dc1-cbc75ef2d532 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:35 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.6605b9fa-31cd-4399-9dc1-cbc75ef2d532 1G Nov 06 18:43:35 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:36 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f015fec8-24f3-42f2-9e36-92b0656e7490 tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.6605b9fa-31cd-4399-9dc1-cbc75ef2d532 1G" returned: 0 in 0.627s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f015fec8-24f3-42f2-9e36-92b0656e7490 tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.6605b9fa-31cd-4399-9dc1-cbc75ef2d532 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:36 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.6605b9fa-31cd-4399-9dc1-cbc75ef2d532 Nov 06 18:43:36 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:36 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f015fec8-24f3-42f2-9e36-92b0656e7490 tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.6605b9fa-31cd-4399-9dc1-cbc75ef2d532" returned: 0 in 0.417s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:36 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-f015fec8-24f3-42f2-9e36-92b0656e7490 tempest-SnapshotsActionsTest-134024785 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.6605b9fa-31cd-4399-9dc1-cbc75ef2d532 is being set with open permissions: ugo+rw Nov 06 18:43:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f015fec8-24f3-42f2-9e36-92b0656e7490 tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.6605b9fa-31cd-4399-9dc1-cbc75ef2d532 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:36 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.6605b9fa-31cd-4399-9dc1-cbc75ef2d532 Nov 06 18:43:36 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:36 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f015fec8-24f3-42f2-9e36-92b0656e7490 tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.6605b9fa-31cd-4399-9dc1-cbc75ef2d532" returned: 0 in 0.329s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f015fec8-24f3-42f2-9e36-92b0656e7490 tempest-SnapshotsActionsTest-134024785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.103s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:36 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-f015fec8-24f3-42f2-9e36-92b0656e7490 tempest-SnapshotsActionsTest-134024785 None] Create snapshot completed successfully Nov 06 18:43:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] Acquiring lock "cinder-6605b9fa-31cd-4399-9dc1-cbc75ef2d532-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-6605b9fa-31cd-4399-9dc1-cbc75ef2d532-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] Acquiring lock "cinder-quobyte-48769eae-62ad-4183-86b1-f37885cf18c9" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-quobyte-48769eae-62ad-4183-86b1-f37885cf18c9" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] Acquiring lock "cinder-quobyte-6605b9fa-31cd-4399-9dc1-cbc75ef2d532" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-quobyte-6605b9fa-31cd-4399-9dc1-cbc75ef2d532" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] Deleting offline snapshot 6605b9fa-31cd-4399-9dc1-cbc75ef2d532 of volume 48769eae-62ad-4183-86b1-f37885cf18c9 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:43:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] snapshot_file for this snap is: volume-48769eae-62ad-4183-86b1-f37885cf18c9.6605b9fa-31cd-4399-9dc1-cbc75ef2d532 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:43:38 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c6fcf7-ea47-4590-b18e-ce3576ab0f70]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.6605b9fa-31cd-4399-9dc1-cbc75ef2d532 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:38 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.6605b9fa-31cd-4399-9dc1-cbc75ef2d532 Nov 06 18:43:38 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:38 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.6605b9fa-31cd-4399-9dc1-cbc75ef2d532" returned: 0 in 0.544s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48769eae-62ad-4183-86b1-f37885cf18c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:43:38 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8587c84-e69b-444c-9c27-0f58fd3cfc04]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:38 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a Nov 06 18:43:38 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:39 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a" returned: 0 in 0.529s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48769eae-62ad-4183-86b1-f37885cf18c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:43:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.6605b9fa-31cd-4399-9dc1-cbc75ef2d532 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:39 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.6605b9fa-31cd-4399-9dc1-cbc75ef2d532 Nov 06 18:43:39 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:39 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.6605b9fa-31cd-4399-9dc1-cbc75ef2d532" returned: 0 in 0.531s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.6605b9fa-31cd-4399-9dc1-cbc75ef2d532 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:39 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:43:39 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.6605b9fa-31cd-4399-9dc1-cbc75ef2d532 Nov 06 18:43:39 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Flow 'volume_create_manager' (f29f21aa-cd4c-4c26-8b08-7bc21f3dd876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:43:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64cd6d1d-1c07-42ab-b8b8-f201d5dbdf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64cd6d1d-1c07-42ab-b8b8-f201d5dbdf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1322657929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e341e9-14a9-438a-9b56-0c34da5b8b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722d1632cefd4842897477eca954f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:43:40Z,use_quota=True,user_id='9ad7a3a46d9e498abeb5a5213daad278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6df46c-ed1e-46ee-8afa-e25db6c96216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6df46c-ed1e-46ee-8afa-e25db6c96216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829fa140-8e5d-42b5-8a52-aa98023af5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829fa140-8e5d-42b5-8a52-aa98023af5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23e341e9-14a9-438a-9b56-0c34da5b8b95', 'volume_name': 'volume-23e341e9-14a9-438a-9b56-0c34da5b8b95', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b453b5-e497-4682-97a9-f31a0831712d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b453b5-e497-4682-97a9-f31a0831712d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5b5a29-7ac5-475c-8c66-430ebe7faf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:40 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Volume 23e341e9-14a9-438a-9b56-0c34da5b8b95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23e341e9-14a9-438a-9b56-0c34da5b8b95', 'volume_size': 1} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1322657929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e341e9-14a9-438a-9b56-0c34da5b8b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722d1632cefd4842897477eca954f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:43:40Z,use_quota=True,user_id='9ad7a3a46d9e498abeb5a5213daad278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Creating volume 23e341e9-14a9-438a-9b56-0c34da5b8b95 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:43:40 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:40 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 1073741824 Nov 06 18:43:40 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:40 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.6605b9fa-31cd-4399-9dc1-cbc75ef2d532" returned: 0 in 0.408s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-quobyte-6605b9fa-31cd-4399-9dc1-cbc75ef2d532" released by "_delete_snapshot" :: held 2.163s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-quobyte-48769eae-62ad-4183-86b1-f37885cf18c9" released by "delete_snapshot" :: held 2.201s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] Created reservations ['a1a64110-1c59-4dac-96fd-e71344d996be', '7b3b33f7-665e-4251-b139-488e65d027c1', '5ee3b6ee-5fa6-46f9-b44d-3f1ce2a51631', '1f20695f-350a-4eb9-a802-404ecfbaf96f'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:43:40 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] Delete snapshot completed successfully. Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-653f0049-96d0-4fca-a7b9-3b4bbeb6a534 tempest-SnapshotsActionsTest-1033973248 None] Lock "cinder-6605b9fa-31cd-4399-9dc1-cbc75ef2d532-delete_snapshot" released by "delete_snapshot" :: held 2.429s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:40 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 1073741824" returned: 0 in 0.555s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:40 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 Nov 06 18:43:40 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:40 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95" returned: 0 in 0.301s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:43:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5b5a29-7ac5-475c-8c66-430ebe7faf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e341e9-14a9-438a-9b56-0c34da5b8b95', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfec349-0238-4b51-9c77-49c0e50acf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:41 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Volume volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 (23e341e9-14a9-438a-9b56-0c34da5b8b95): created successfully Nov 06 18:43:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfec349-0238-4b51-9c77-49c0e50acf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Flow 'volume_create_manager' (f29f21aa-cd4c-4c26-8b08-7bc21f3dd876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:43:41 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-b19d887d-62c3-484a-8c25-5e0368a7fd07 tempest-VolumesDeleteCascade-306483724 None] Created volume successfully. Nov 06 18:43:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] Acquiring lock "cinder-8f395804-0d5b-49d4-97ac-28095f251d2a-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] Lock "cinder-8f395804-0d5b-49d4-97ac-28095f251d2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] Acquiring lock "cinder-quobyte-48769eae-62ad-4183-86b1-f37885cf18c9" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] Lock "cinder-quobyte-48769eae-62ad-4183-86b1-f37885cf18c9" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] Acquiring lock "cinder-quobyte-8f395804-0d5b-49d4-97ac-28095f251d2a" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] Lock "cinder-quobyte-8f395804-0d5b-49d4-97ac-28095f251d2a" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] Deleting offline snapshot 8f395804-0d5b-49d4-97ac-28095f251d2a of volume 48769eae-62ad-4183-86b1-f37885cf18c9 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:43:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] snapshot_file for this snap is: volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:43:42 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bed0d4-00bc-4703-b180-739a69973718]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:42 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a Nov 06 18:43:42 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-414d076b-c2c1-4591-ae0f-c02d049218b2 tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-414d076b-c2c1-4591-ae0f-c02d049218b2 tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-414d076b-c2c1-4591-ae0f-c02d049218b2 tempest-VolumesDeleteCascade-306483724 None] Creating offline snapshot 22c15feb-0ffe-46da-bf86-09368ef24f2c of volume 23e341e9-14a9-438a-9b56-0c34da5b8b95 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:43:42 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[41537551-e936-491f-91f1-d0c4ba0783ed]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-414d076b-c2c1-4591-ae0f-c02d049218b2 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:42 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 Nov 06 18:43:42 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:42 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a" returned: 0 in 0.574s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48769eae-62ad-4183-86b1-f37885cf18c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:43:42 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[60efc566-cf2c-4057-a6ab-06b85993fabe]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:43 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9 Nov 06 18:43:43 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:43 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-414d076b-c2c1-4591-ae0f-c02d049218b2 tempest-VolumesDeleteCascade-306483724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95" returned: 0 in 0.605s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-414d076b-c2c1-4591-ae0f-c02d049218b2 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:43 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c 1G Nov 06 18:43:43 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:43 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9" returned: 0 in 0.558s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:43 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a Nov 06 18:43:43 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:43 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-414d076b-c2c1-4591-ae0f-c02d049218b2 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c 1G" returned: 0 in 0.675s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-414d076b-c2c1-4591-ae0f-c02d049218b2 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:43 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c Nov 06 18:43:43 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:43 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a" returned: 0 in 0.509s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:44 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a Nov 06 18:43:44 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:44 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-414d076b-c2c1-4591-ae0f-c02d049218b2 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c" returned: 0 in 0.470s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:44 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-414d076b-c2c1-4591-ae0f-c02d049218b2 tempest-VolumesDeleteCascade-306483724 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c is being set with open permissions: ugo+rw Nov 06 18:43:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-414d076b-c2c1-4591-ae0f-c02d049218b2 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:44 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c Nov 06 18:43:44 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:44 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9.8f395804-0d5b-49d4-97ac-28095f251d2a" returned: 0 in 0.439s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] Lock "cinder-quobyte-8f395804-0d5b-49d4-97ac-28095f251d2a" released by "_delete_snapshot" :: held 2.342s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] Lock "cinder-quobyte-48769eae-62ad-4183-86b1-f37885cf18c9" released by "delete_snapshot" :: held 2.392s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:44 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-414d076b-c2c1-4591-ae0f-c02d049218b2 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c" returned: 0 in 0.333s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:44 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] Created reservations ['f61c30ed-1928-4364-8014-47ec3ddde3cf', '9c9c7eb4-588f-43e8-b15c-d150085c097a', 'c57808ac-46bd-4866-ac41-c5c416855790', '9cb1bd96-ebcb-4489-9e63-189ab91f879c'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:43:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-414d076b-c2c1-4591-ae0f-c02d049218b2 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:44 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.info Nov 06 18:43:44 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:44 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] Delete snapshot completed successfully. Nov 06 18:43:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a24523b2-20fd-4b1c-a880-9ca5c5e9786e tempest-SnapshotsActionsTest-134024785 None] Lock "cinder-8f395804-0d5b-49d4-97ac-28095f251d2a-delete_snapshot" released by "delete_snapshot" :: held 2.646s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:45 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-414d076b-c2c1-4591-ae0f-c02d049218b2 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.info" returned: 0 in 0.361s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:45 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-414d076b-c2c1-4591-ae0f-c02d049218b2 tempest-VolumesDeleteCascade-306483724 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.info is being set with open permissions: ugo+rw Nov 06 18:43:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-414d076b-c2c1-4591-ae0f-c02d049218b2 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:45 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.info Nov 06 18:43:45 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:45 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-414d076b-c2c1-4591-ae0f-c02d049218b2 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.info" returned: 0 in 0.348s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-414d076b-c2c1-4591-ae0f-c02d049218b2 tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.949s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:45 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-414d076b-c2c1-4591-ae0f-c02d049218b2 tempest-VolumesDeleteCascade-306483724 None] Create snapshot completed successfully Nov 06 18:43:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c8592b1b-94e1-452f-8e22-78711c78f3bc tempest-SnapshotsActionsTest-134024785 None] Acquiring lock "cinder-48769eae-62ad-4183-86b1-f37885cf18c9-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c8592b1b-94e1-452f-8e22-78711c78f3bc tempest-SnapshotsActionsTest-134024785 None] Lock "cinder-48769eae-62ad-4183-86b1-f37885cf18c9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c8592b1b-94e1-452f-8e22-78711c78f3bc tempest-SnapshotsActionsTest-134024785 None] Acquiring lock "cinder-quobyte-48769eae-62ad-4183-86b1-f37885cf18c9" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c8592b1b-94e1-452f-8e22-78711c78f3bc tempest-SnapshotsActionsTest-134024785 None] Lock "cinder-quobyte-48769eae-62ad-4183-86b1-f37885cf18c9" acquired by "delete_volume" :: waited 0.029s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:45 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd53d1c4-2fef-4a39-8e97-01657abc3645]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c8592b1b-94e1-452f-8e22-78711c78f3bc tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:45 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9 Nov 06 18:43:45 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8425db8a-4a49-47af-8ae2-1613ed64965e tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8425db8a-4a49-47af-8ae2-1613ed64965e tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:45 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-8425db8a-4a49-47af-8ae2-1613ed64965e tempest-VolumesDeleteCascade-306483724 None] Creating offline snapshot c4662ee8-1e16-42b5-8407-a7cc5dca728e of volume 23e341e9-14a9-438a-9b56-0c34da5b8b95 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:43:46 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b70e97-044d-4b62-b01c-d395b8bc95c4]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8425db8a-4a49-47af-8ae2-1613ed64965e tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:46 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c Nov 06 18:43:46 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:46 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c8592b1b-94e1-452f-8e22-78711c78f3bc tempest-SnapshotsActionsTest-134024785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9" returned: 0 in 0.566s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c8592b1b-94e1-452f-8e22-78711c78f3bc tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:46 devstack sudo[99523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9 Nov 06 18:43:46 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:46 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8425db8a-4a49-47af-8ae2-1613ed64965e tempest-VolumesDeleteCascade-306483724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c" returned: 0 in 0.534s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-8425db8a-4a49-47af-8ae2-1613ed64965e tempest-VolumesDeleteCascade-306483724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23e341e9-14a9-438a-9b56-0c34da5b8b95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:43:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8425db8a-4a49-47af-8ae2-1613ed64965e tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:46 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e 1G Nov 06 18:43:46 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:46 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c8592b1b-94e1-452f-8e22-78711c78f3bc tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-48769eae-62ad-4183-86b1-f37885cf18c9" returned: 0 in 0.366s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:46 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c8592b1b-94e1-452f-8e22-78711c78f3bc tempest-SnapshotsActionsTest-134024785 None] Lock "cinder-quobyte-48769eae-62ad-4183-86b1-f37885cf18c9" released by "delete_volume" :: held 1.022s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:46 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-c8592b1b-94e1-452f-8e22-78711c78f3bc tempest-SnapshotsActionsTest-134024785 None] Created reservations ['844b94a4-b57c-4847-a25d-fec08ad108c1', '7b3d4054-7d2b-4e12-861e-81c800495c2f', '15cc5392-ae98-45f6-b648-8cc3379d74fc', 'fcf78d4c-9f62-490f-a496-919ce7e2e00a'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:43:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c8592b1b-94e1-452f-8e22-78711c78f3bc tempest-SnapshotsActionsTest-134024785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c8592b1b-94e1-452f-8e22-78711c78f3bc tempest-SnapshotsActionsTest-134024785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c8592b1b-94e1-452f-8e22-78711c78f3bc tempest-SnapshotsActionsTest-134024785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:43:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c8592b1b-94e1-452f-8e22-78711c78f3bc tempest-SnapshotsActionsTest-134024785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:43:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c8592b1b-94e1-452f-8e22-78711c78f3bc tempest-SnapshotsActionsTest-134024785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c8592b1b-94e1-452f-8e22-78711c78f3bc tempest-SnapshotsActionsTest-134024785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:46 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:43:46 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:47 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8425db8a-4a49-47af-8ae2-1613ed64965e tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e 1G" returned: 0 in 0.603s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8425db8a-4a49-47af-8ae2-1613ed64965e tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:47 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c8592b1b-94e1-452f-8e22-78711c78f3bc tempest-SnapshotsActionsTest-134024785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.316s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:47 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-c8592b1b-94e1-452f-8e22-78711c78f3bc tempest-SnapshotsActionsTest-134024785 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:43:47 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c8592b1b-94e1-452f-8e22-78711c78f3bc tempest-SnapshotsActionsTest-134024785 None] Deleted volume successfully. Nov 06 18:43:47 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e Nov 06 18:43:47 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:47 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c8592b1b-94e1-452f-8e22-78711c78f3bc tempest-SnapshotsActionsTest-134024785 None] Lock "cinder-48769eae-62ad-4183-86b1-f37885cf18c9-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:47 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8425db8a-4a49-47af-8ae2-1613ed64965e tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e" returned: 0 in 0.380s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:47 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-8425db8a-4a49-47af-8ae2-1613ed64965e tempest-VolumesDeleteCascade-306483724 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e is being set with open permissions: ugo+rw Nov 06 18:43:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8425db8a-4a49-47af-8ae2-1613ed64965e tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:47 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e Nov 06 18:43:47 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:47 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8425db8a-4a49-47af-8ae2-1613ed64965e tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e" returned: 0 in 0.323s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8425db8a-4a49-47af-8ae2-1613ed64965e tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:47 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-8425db8a-4a49-47af-8ae2-1613ed64965e tempest-VolumesDeleteCascade-306483724 None] Create snapshot completed successfully Nov 06 18:43:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "cinder-23e341e9-14a9-438a-9b56-0c34da5b8b95-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-23e341e9-14a9-438a-9b56-0c34da5b8b95-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Performing cascade delete. {{(pid=86794) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 06 18:43:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "cinder-22c15feb-0ffe-46da-bf86-09368ef24f2c-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-22c15feb-0ffe-46da-bf86-09368ef24f2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "cinder-quobyte-23e341e9-14a9-438a-9b56-0c34da5b8b95" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-23e341e9-14a9-438a-9b56-0c34da5b8b95" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "cinder-quobyte-22c15feb-0ffe-46da-bf86-09368ef24f2c" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-22c15feb-0ffe-46da-bf86-09368ef24f2c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Deleting offline snapshot 22c15feb-0ffe-46da-bf86-09368ef24f2c of volume 23e341e9-14a9-438a-9b56-0c34da5b8b95 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:43:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] snapshot_file for this snap is: volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:43:48 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[0284a0f0-6241-42bf-96c1-c13ffc48cd62]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:48 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c Nov 06 18:43:48 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:49 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c" returned: 0 in 0.570s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:49 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23e341e9-14a9-438a-9b56-0c34da5b8b95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:43:49 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3687370-96df-4279-8839-b046eada1ebb]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:49 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 Nov 06 18:43:49 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:49 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95" returned: 0 in 0.505s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:49 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4a53da-b4c3-47b8-afca-059a81c692b1]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:49 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e Nov 06 18:43:49 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:50 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e" returned: 0 in 0.490s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:50 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23e341e9-14a9-438a-9b56-0c34da5b8b95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:43:50 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29fe100-1ce8-452e-9cf0-1a515826a11f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:50 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c Nov 06 18:43:50 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:50 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c" returned: 0 in 0.577s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:50 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23e341e9-14a9-438a-9b56-0c34da5b8b95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:43:50 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d67778-707a-4ecb-81d7-fc4b0bab87d2]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:51 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 Nov 06 18:43:51 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:51 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95" returned: 0 in 0.483s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:51 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c Nov 06 18:43:51 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:51 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c" returned: 0 in 0.454s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:51 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c Nov 06 18:43:51 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:52 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.22c15feb-0ffe-46da-bf86-09368ef24f2c" returned: 0 in 0.381s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e -F qcow2 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:52 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e -F qcow2 Nov 06 18:43:52 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:52 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e -F qcow2" returned: 0 in 0.317s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-22c15feb-0ffe-46da-bf86-09368ef24f2c" released by "_delete_snapshot" :: held 4.094s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-23e341e9-14a9-438a-9b56-0c34da5b8b95" released by "delete_snapshot" :: held 4.125s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:52 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Created reservations ['163f7c38-abc3-4a67-9115-74e7e4cc6ed9', 'd793e552-dad4-4104-b1c2-3883e4b0438c', '9854f127-ea3c-47c0-84e6-f2e3c6b946da', '8e1a41dc-1644-4e05-b901-e548abd4df40'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:43:52 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Delete snapshot completed successfully. Nov 06 18:43:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-22c15feb-0ffe-46da-bf86-09368ef24f2c-delete_snapshot" released by "delete_snapshot" :: held 4.306s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "cinder-c4662ee8-1e16-42b5-8407-a7cc5dca728e-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-c4662ee8-1e16-42b5-8407-a7cc5dca728e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "cinder-quobyte-23e341e9-14a9-438a-9b56-0c34da5b8b95" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-23e341e9-14a9-438a-9b56-0c34da5b8b95" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "cinder-quobyte-c4662ee8-1e16-42b5-8407-a7cc5dca728e" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-c4662ee8-1e16-42b5-8407-a7cc5dca728e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Deleting offline snapshot c4662ee8-1e16-42b5-8407-a7cc5dca728e of volume 23e341e9-14a9-438a-9b56-0c34da5b8b95 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:43:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] snapshot_file for this snap is: volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:43:52 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da7eea6-1db6-43a9-a7ce-7a71d0431485]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:52 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e Nov 06 18:43:52 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:53 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e" returned: 0 in 0.409s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23e341e9-14a9-438a-9b56-0c34da5b8b95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:43:53 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecab981-b1a3-47e5-89ca-df647ac48f5f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:53 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 Nov 06 18:43:53 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:53 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95" returned: 0 in 0.442s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:53 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e Nov 06 18:43:53 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:54 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e" returned: 0 in 0.502s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:54 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e Nov 06 18:43:54 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:54 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95.c4662ee8-1e16-42b5-8407-a7cc5dca728e" returned: 0 in 0.426s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-c4662ee8-1e16-42b5-8407-a7cc5dca728e" released by "_delete_snapshot" :: held 1.937s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-23e341e9-14a9-438a-9b56-0c34da5b8b95" released by "delete_snapshot" :: held 1.972s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:54 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Created reservations ['49abf6f1-8a6a-42c1-a337-cf4aa9170488', '7e628997-6e7c-447d-a6ff-f7bf99423504', '13c5489b-c611-46ae-b042-a796f2279cf8', '7b4c0ff6-3e3e-4a3e-bc91-64c32b430e8a'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:43:54 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Delete snapshot completed successfully. Nov 06 18:43:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-c4662ee8-1e16-42b5-8407-a7cc5dca728e-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Snapshots deleted, issuing volume delete {{(pid=86794) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 06 18:43:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "cinder-quobyte-23e341e9-14a9-438a-9b56-0c34da5b8b95" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:43:55 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-23e341e9-14a9-438a-9b56-0c34da5b8b95" acquired by "delete_volume" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:43:55 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64d3684-0ba1-4089-b60d-3f95ce338060]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:43:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:55 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 Nov 06 18:43:55 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:56 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95" returned: 0 in 1.011s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:56 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95 Nov 06 18:43:56 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:56 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-23e341e9-14a9-438a-9b56-0c34da5b8b95" returned: 0 in 0.581s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:56 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-23e341e9-14a9-438a-9b56-0c34da5b8b95" released by "delete_volume" :: held 1.753s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:56 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=107,cinder:UPDATE=114,cinder:INSERT=33,cinder:DELETE=6 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:43:56 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Created reservations ['25ed52ad-1139-4635-b156-e8272bcfbf31', '1a0138cd-d2c4-47fa-bcd8-e3cdc4a99ac4', '87e79ea1-bf88-4a2e-9a6e-728abf6097ac', '3de7204a-2d26-40bb-87d5-7d2c92b4e565'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:43:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:57 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:43:57 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:43:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:57 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:43:57 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:57 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.520s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:57 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:43:57 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Deleted volume successfully. Nov 06 18:43:57 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=117,cinder:INSERT=36,cinder:UPDATE=130,cinder:DELETE=14 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:43:57 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-bbb7df2a-9df3-421d-b9cf-677cda412b33 tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-23e341e9-14a9-438a-9b56-0c34da5b8b95-delete_volume" released by "delete_volume" :: held 9.535s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Flow 'volume_create_manager' (8f0fe6de-10ad-41c3-a4e9-9e9223c60f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c62a2e-27e0-476e-8cb9-f466cf959233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c62a2e-27e0-476e-8cb9-f466cf959233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-81395641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6185df-926d-49fb-a894-feddb5832e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722d1632cefd4842897477eca954f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:43:59Z,use_quota=True,user_id='9ad7a3a46d9e498abeb5a5213daad278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0c1d54-5f5e-4b37-901a-582d68c4768b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0c1d54-5f5e-4b37-901a-582d68c4768b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31042c2-86ac-4187-9b1b-cc60dc7ec465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31042c2-86ac-4187-9b1b-cc60dc7ec465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a6185df-926d-49fb-a894-feddb5832e7d', 'volume_name': 'volume-5a6185df-926d-49fb-a894-feddb5832e7d', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9779897-e3e9-4f63-a3e6-0c0378825357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9779897-e3e9-4f63-a3e6-0c0378825357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (869053ae-5195-4bec-9003-12d24d138169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:43:58 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Volume 5a6185df-926d-49fb-a894-feddb5832e7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a6185df-926d-49fb-a894-feddb5832e7d', 'volume_size': 1} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-81395641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6185df-926d-49fb-a894-feddb5832e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722d1632cefd4842897477eca954f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:43:59Z,use_quota=True,user_id='9ad7a3a46d9e498abeb5a5213daad278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Creating volume 5a6185df-926d-49fb-a894-feddb5832e7d {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:43:58 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:43:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:43:59 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d 1073741824 Nov 06 18:43:59 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:43:59 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Nov 06 18:43:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d 1073741824" returned: 0 in 0.968s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:43:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:00 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d Nov 06 18:44:00 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:00 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d" returned: 0 in 0.378s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:44:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (869053ae-5195-4bec-9003-12d24d138169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a6185df-926d-49fb-a894-feddb5832e7d', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba420f67-5694-4cdd-b19b-87468be11d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:00 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Volume volume-5a6185df-926d-49fb-a894-feddb5832e7d (5a6185df-926d-49fb-a894-feddb5832e7d): created successfully Nov 06 18:44:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba420f67-5694-4cdd-b19b-87468be11d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Flow 'volume_create_manager' (8f0fe6de-10ad-41c3-a4e9-9e9223c60f60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:00 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-24760977-e026-4b07-9a1a-b96f30efe681 tempest-VolumesDeleteCascade-306483724 None] Created volume successfully. Nov 06 18:44:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d9f82d63-1f80-4358-bd2c-86b974a52d64 tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d9f82d63-1f80-4358-bd2c-86b974a52d64 tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:01 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-d9f82d63-1f80-4358-bd2c-86b974a52d64 tempest-VolumesDeleteCascade-306483724 None] Creating offline snapshot e9a30a2e-253f-40b4-86bd-b2624b526b1b of volume 5a6185df-926d-49fb-a894-feddb5832e7d {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:44:01 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64c80f7-1e39-42d1-8dcf-8ca267d6ca05]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d9f82d63-1f80-4358-bd2c-86b974a52d64 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:01 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d Nov 06 18:44:01 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:02 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d9f82d63-1f80-4358-bd2c-86b974a52d64 tempest-VolumesDeleteCascade-306483724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d" returned: 0 in 0.669s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d9f82d63-1f80-4358-bd2c-86b974a52d64 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:02 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b 1G Nov 06 18:44:02 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:02 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d9f82d63-1f80-4358-bd2c-86b974a52d64 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b 1G" returned: 0 in 0.867s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d9f82d63-1f80-4358-bd2c-86b974a52d64 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a6185df-926d-49fb-a894-feddb5832e7d -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:02 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a6185df-926d-49fb-a894-feddb5832e7d -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b Nov 06 18:44:02 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:03 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d9f82d63-1f80-4358-bd2c-86b974a52d64 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a6185df-926d-49fb-a894-feddb5832e7d -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b" returned: 0 in 0.541s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:03 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-d9f82d63-1f80-4358-bd2c-86b974a52d64 tempest-VolumesDeleteCascade-306483724 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b is being set with open permissions: ugo+rw Nov 06 18:44:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d9f82d63-1f80-4358-bd2c-86b974a52d64 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:03 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b Nov 06 18:44:03 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:03 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d9f82d63-1f80-4358-bd2c-86b974a52d64 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b" returned: 0 in 0.350s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d9f82d63-1f80-4358-bd2c-86b974a52d64 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:03 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.info Nov 06 18:44:03 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:04 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d9f82d63-1f80-4358-bd2c-86b974a52d64 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.info" returned: 0 in 0.581s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:04 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-d9f82d63-1f80-4358-bd2c-86b974a52d64 tempest-VolumesDeleteCascade-306483724 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.info is being set with open permissions: ugo+rw Nov 06 18:44:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d9f82d63-1f80-4358-bd2c-86b974a52d64 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:04 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.info Nov 06 18:44:04 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:04 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d9f82d63-1f80-4358-bd2c-86b974a52d64 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.info" returned: 0 in 0.368s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d9f82d63-1f80-4358-bd2c-86b974a52d64 tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.540s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:04 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-d9f82d63-1f80-4358-bd2c-86b974a52d64 tempest-VolumesDeleteCascade-306483724 None] Create snapshot completed successfully Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Flow 'volume_create_manager' (5dcdd325-2cf8-417f-a81d-08e10fe7b7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d4bc5b-5681-4412-8a8c-4440878ec2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d4bc5b-5681-4412-8a8c-4440878ec2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-56939078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e1ab71-75df-486a-bde2-d0a498bf5aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722d1632cefd4842897477eca954f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e9a30a2e-253f-40b4-86bd-b2624b526b1b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:06Z,use_quota=True,user_id='9ad7a3a46d9e498abeb5a5213daad278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6646fb30-1445-49d6-9199-0f263d22cbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6646fb30-1445-49d6-9199-0f263d22cbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b6c73db-33be-4013-a2d7-ab26033cb50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b6c73db-33be-4013-a2d7-ab26033cb50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '36e1ab71-75df-486a-bde2-d0a498bf5aa9', 'volume_name': 'volume-36e1ab71-75df-486a-bde2-d0a498bf5aa9', 'volume_size': 1, 'snapshot_id': 'e9a30a2e-253f-40b4-86bd-b2624b526b1b'}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8c135f-844e-41af-a8e4-93f661cec24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8c135f-844e-41af-a8e4-93f661cec24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e702ac03-1205-4f38-b53c-fb7ee858ed84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:06 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Volume 36e1ab71-75df-486a-bde2-d0a498bf5aa9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-36e1ab71-75df-486a-bde2-d0a498bf5aa9', 'volume_size': 1, 'snapshot_id': 'e9a30a2e-253f-40b4-86bd-b2624b526b1b'} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "cinder-quobyte-e9a30a2e-253f-40b4-86bd-b2624b526b1b-36e1ab71-75df-486a-bde2-d0a498bf5aa9" by "_create_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-e9a30a2e-253f-40b4-86bd-b2624b526b1b-36e1ab71-75df-486a-bde2-d0a498bf5aa9" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Creating volume 36e1ab71-75df-486a-bde2-d0a498bf5aa9 from snapshot e9a30a2e-253f-40b4-86bd-b2624b526b1b {{(pid=86794) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "cinder-quobyte-36e1ab71-75df-486a-bde2-d0a498bf5aa9" by "_copy_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-36e1ab71-75df-486a-bde2-d0a498bf5aa9" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] snapshot: e9a30a2e-253f-40b4-86bd-b2624b526b1b, volume: 36e1ab71-75df-486a-bde2-d0a498bf5aa9, {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ac1c8a-a561-4a18-8c84-b11aa56db2b6]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:06 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b Nov 06 18:44:06 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:07 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b" returned: 0 in 0.455s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a6185df-926d-49fb-a894-feddb5832e7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:44:07 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[1544c9a5-fdf1-4742-addd-7a7f18d0116f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:07 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d Nov 06 18:44:07 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:07 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d" returned: 0 in 0.572s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 18:44:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Creating direct copy from snapshot {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 18:44:07 devstack cinder-volume[86794]: DEBUG cinder.utils [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Path /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36e1ab71-75df-486a-bde2-d0a498bf5aa9 not found in is_blk_device check {{(pid=86794) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 18:44:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36e1ab71-75df-486a-bde2-d0a498bf5aa9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:07 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36e1ab71-75df-486a-bde2-d0a498bf5aa9 Nov 06 18:44:07 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:08 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:44:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Flow 'volume_create_manager' (461a6253-2bb3-4b54-b8ba-731df671b6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a4a7f15-3599-4d14-9890-58de3ade9c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a4a7f15-3599-4d14-9890-58de3ade9c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1241557520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a87e136-5f3f-4712-a596-538b8b41f5ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79585b40d71840bd8b89880ec756cb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:08Z,use_quota=True,user_id='11b65ead679f42e29c31f43effd9a79e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7282bdec-afdf-4deb-b741-128e5b54f12a),volume_type_id=7282bdec-afdf-4deb-b741-128e5b54f12a)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c870882-631c-4e65-92f8-46271d9bb9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c870882-631c-4e65-92f8-46271d9bb9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02061762-5e4d-4f1e-a973-3a75b1dcd57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02061762-5e4d-4f1e-a973-3a75b1dcd57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a87e136-5f3f-4712-a596-538b8b41f5ba', 'volume_name': 'volume-6a87e136-5f3f-4712-a596-538b8b41f5ba', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6584cc-fbe7-401d-9213-c2461937ad13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6584cc-fbe7-401d-9213-c2461937ad13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d1adda-4fc5-420f-9027-74104657c599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:08 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Volume 6a87e136-5f3f-4712-a596-538b8b41f5ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a87e136-5f3f-4712-a596-538b8b41f5ba', 'volume_size': 1} Nov 06 18:44:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:09 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:44:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Flow 'volume_create_manager' (fd61fbec-b8d7-4ee4-bc07-0044f41a18f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016aed2f-278b-4521-9167-64ad9a7b0771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016aed2f-278b-4521-9167-64ad9a7b0771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1732756665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85855a9-fd40-4000-810f-5ceb9f3ae1f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79585b40d71840bd8b89880ec756cb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:09Z,use_quota=True,user_id='11b65ead679f42e29c31f43effd9a79e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22a2143a-cd79-4c59-b627-6b6228dfded4),volume_type_id=22a2143a-cd79-4c59-b627-6b6228dfded4)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b2daa5-2888-4218-8f2e-438241360420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b2daa5-2888-4218-8f2e-438241360420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66a20d4-18c4-4af6-9f03-33118380dcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66a20d4-18c4-4af6-9f03-33118380dcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b85855a9-fd40-4000-810f-5ceb9f3ae1f4', 'volume_name': 'volume-b85855a9-fd40-4000-810f-5ceb9f3ae1f4', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0916219-bf09-4c50-b5b9-1029c25feafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0916219-bf09-4c50-b5b9-1029c25feafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (652c1675-49fe-471d-af16-6fc7fc8436e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:09 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Volume b85855a9-fd40-4000-810f-5ceb9f3ae1f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b85855a9-fd40-4000-810f-5ceb9f3ae1f4', 'volume_size': 1} Nov 06 18:44:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:10 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:44:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Flow 'volume_create_manager' (dd82b92b-e057-46a1-93cf-dd898fec4247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72df405-c3dc-469e-b147-0fb4dbd23e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72df405-c3dc-469e-b147-0fb4dbd23e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2140983986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b70858-8a68-4989-9091-783cd6163b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79585b40d71840bd8b89880ec756cb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:10Z,use_quota=True,user_id='11b65ead679f42e29c31f43effd9a79e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea5ac385-e9b6-4e3a-84ad-23d07b89773b),volume_type_id=ea5ac385-e9b6-4e3a-84ad-23d07b89773b)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca10ae94-f00b-4f59-a306-8db9e0d686b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca10ae94-f00b-4f59-a306-8db9e0d686b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee17940-ba06-4201-badf-ecd86299d0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:10 devstack cinder-volume[86794]: DEBUG cinder.image.glance [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Creating Keystone auth plugin from conf {{(pid=86794) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 18:44:11 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:44:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Flow 'volume_create_manager' (7a3835d3-b673-446b-ba73-57b2899a14a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e1df013-0a25-4969-a7e1-ea6950d9b3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e1df013-0a25-4969-a7e1-ea6950d9b3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1669306192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109587c4-e974-47f4-aa22-4293fde2473b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='439ca504f60349ff86a10ac4b2a75496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:11Z,use_quota=True,user_id='0f9d5a4b1cbc448baaaf0e572cd53837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(022ed6dc-c8e5-44b2-afc8-e6b639c0a89f),volume_type_id=022ed6dc-c8e5-44b2-afc8-e6b639c0a89f)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4558ab-144d-43e6-b7ce-1f4d7c842307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4558ab-144d-43e6-b7ce-1f4d7c842307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc626d4-c115-4dd1-b4b3-c1470f8544c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc626d4-c115-4dd1-b4b3-c1470f8544c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '109587c4-e974-47f4-aa22-4293fde2473b', 'volume_name': 'volume-109587c4-e974-47f4-aa22-4293fde2473b', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81800ee8-481c-46d7-9e32-0831d396bdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81800ee8-481c-46d7-9e32-0831d396bdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b54ab4-dc51-4e40-9489-b190e9fe69ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:11 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Volume 109587c4-e974-47f4-aa22-4293fde2473b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-109587c4-e974-47f4-aa22-4293fde2473b', 'volume_size': 1} Nov 06 18:44:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee17940-ba06-4201-badf-ecd86299d0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '67b70858-8a68-4989-9091-783cd6163b93', 'volume_name': 'volume-67b70858-8a68-4989-9091-783cd6163b93', 'volume_size': 1, 'image_id': 'c9ec8fff-5db2-481e-9e87-cd444528be1e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9ec8fff-5db2-481e-9e87-cd444528be1e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1815322444', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '79585b40d71840bd8b89880ec756cb2d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c9ec8fff-5db2-481e-9e87-cd444528be1e', 'created_at': datetime.datetime(2026, 11, 6, 17, 44, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 44, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9ec8fff-5db2-481e-9e87-cd444528be1e/file', 'properties': {}}, 'image_service': }' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0900e8d9-2d67-4aac-b252-eec40f8b9cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0900e8d9-2d67-4aac-b252-eec40f8b9cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069992ce-73ad-402f-86cf-98becfde1dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:11 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Volume 67b70858-8a68-4989-9091-783cd6163b93: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-67b70858-8a68-4989-9091-783cd6163b93', 'volume_size': 1, 'image_id': 'c9ec8fff-5db2-481e-9e87-cd444528be1e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9ec8fff-5db2-481e-9e87-cd444528be1e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1815322444', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '79585b40d71840bd8b89880ec756cb2d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c9ec8fff-5db2-481e-9e87-cd444528be1e', 'created_at': datetime.datetime(2026, 11, 6, 17, 44, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 44, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9ec8fff-5db2-481e-9e87-cd444528be1e/file', 'properties': {}}, 'image_service': } Nov 06 18:44:11 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Trying to clone 67b70858-8a68-4989-9091-783cd6163b93 from image c9ec8fff-5db2-481e-9e87-cd444528be1e at location (None, [{'url': 'file:///opt/stack/data/glance/images/c9ec8fff-5db2-481e-9e87-cd444528be1e', 'metadata': {}}]). {{(pid=86794) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 18:44:15 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36e1ab71-75df-486a-bde2-d0a498bf5aa9" returned: 0 in 7.747s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d, size 1024.00 MB, duration 7.75 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36e1ab71-75df-486a-bde2-d0a498bf5aa9 {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:44:15 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Converted 1024.00 MB image at 132.12 MB/s Nov 06 18:44:15 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36e1ab71-75df-486a-bde2-d0a498bf5aa9 is being set with open permissions: ugo+rw Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36e1ab71-75df-486a-bde2-d0a498bf5aa9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:15 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36e1ab71-75df-486a-bde2-d0a498bf5aa9 Nov 06 18:44:15 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:15 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36e1ab71-75df-486a-bde2-d0a498bf5aa9" returned: 0 in 0.250s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-36e1ab71-75df-486a-bde2-d0a498bf5aa9" released by "_copy_volume_from_snapshot" :: held 9.164s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-e9a30a2e-253f-40b4-86bd-b2624b526b1b-36e1ab71-75df-486a-bde2-d0a498bf5aa9" released by "_create_volume_from_snapshot" :: held 9.255s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.281s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.535s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1241557520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a87e136-5f3f-4712-a596-538b8b41f5ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79585b40d71840bd8b89880ec756cb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:08Z,use_quota=True,user_id='11b65ead679f42e29c31f43effd9a79e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7282bdec-afdf-4deb-b741-128e5b54f12a),volume_type_id=7282bdec-afdf-4deb-b741-128e5b54f12a)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Creating volume 6a87e136-5f3f-4712-a596-538b8b41f5ba {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:44:15 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6a87e136-5f3f-4712-a596-538b8b41f5ba 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:15 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6a87e136-5f3f-4712-a596-538b8b41f5ba 1073741824 Nov 06 18:44:15 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e702ac03-1205-4f38-b53c-fb7ee858ed84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36e1ab71-75df-486a-bde2-d0a498bf5aa9', 'volume_size': 1, 'snapshot_id': 'e9a30a2e-253f-40b4-86bd-b2624b526b1b'}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d9436ec-97dd-40e7-b3c8-46e1e74398c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:15 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Volume volume-36e1ab71-75df-486a-bde2-d0a498bf5aa9 (36e1ab71-75df-486a-bde2-d0a498bf5aa9): created successfully Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d9436ec-97dd-40e7-b3c8-46e1e74398c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Flow 'volume_create_manager' (5dcdd325-2cf8-417f-a81d-08e10fe7b7ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:15 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-b8bb6de3-3d9f-4b20-953b-5d48a7dbeacc tempest-VolumesDeleteCascade-306483724 None] Created volume successfully. Nov 06 18:44:16 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6a87e136-5f3f-4712-a596-538b8b41f5ba 1073741824" returned: 0 in 0.540s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6a87e136-5f3f-4712-a596-538b8b41f5ba {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:16 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6a87e136-5f3f-4712-a596-538b8b41f5ba Nov 06 18:44:16 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "cinder-5a6185df-926d-49fb-a894-feddb5832e7d-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-5a6185df-926d-49fb-a894-feddb5832e7d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Performing cascade delete. {{(pid=86794) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "cinder-e9a30a2e-253f-40b4-86bd-b2624b526b1b-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-e9a30a2e-253f-40b4-86bd-b2624b526b1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "cinder-quobyte-5a6185df-926d-49fb-a894-feddb5832e7d" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:16 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6a87e136-5f3f-4712-a596-538b8b41f5ba" returned: 0 in 0.396s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-5a6185df-926d-49fb-a894-feddb5832e7d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "cinder-quobyte-e9a30a2e-253f-40b4-86bd-b2624b526b1b" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.494s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1732756665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85855a9-fd40-4000-810f-5ceb9f3ae1f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79585b40d71840bd8b89880ec756cb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:09Z,use_quota=True,user_id='11b65ead679f42e29c31f43effd9a79e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22a2143a-cd79-4c59-b627-6b6228dfded4),volume_type_id=22a2143a-cd79-4c59-b627-6b6228dfded4)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Creating volume b85855a9-fd40-4000-810f-5ceb9f3ae1f4 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:44:16 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b85855a9-fd40-4000-810f-5ceb9f3ae1f4 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:16 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b85855a9-fd40-4000-810f-5ceb9f3ae1f4 1073741824 Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d1adda-4fc5-420f-9027-74104657c599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a87e136-5f3f-4712-a596-538b8b41f5ba', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:16 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc41cd8-9b61-4f12-9dc2-de699365116c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-e9a30a2e-253f-40b4-86bd-b2624b526b1b" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Deleting offline snapshot e9a30a2e-253f-40b4-86bd-b2624b526b1b of volume 5a6185df-926d-49fb-a894-feddb5832e7d {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] snapshot_file for this snap is: volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:44:16 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Volume volume-6a87e136-5f3f-4712-a596-538b8b41f5ba (6a87e136-5f3f-4712-a596-538b8b41f5ba): created successfully Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc41cd8-9b61-4f12-9dc2-de699365116c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Flow 'volume_create_manager' (461a6253-2bb3-4b54-b8ba-731df671b6e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44762ce-be6a-4627-b13c-428a07a58e5f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:16 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-f79323f2-2129-4086-8eab-80a6624c30ab tempest-TestInstancesWithCinderVolumes-1982719473 None] Created volume successfully. Nov 06 18:44:16 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c9ec8fff-5db2-481e-9e87-cd444528be1e_h86ty19vdevstack@QuobyteHD, size 20.69 MB, duration 5.28 sec {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 18:44:16 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Image download 20.69 MB at 3.92 MB/s Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[36083244-a8c1-41cf-92d0-d70219fcc9c1]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ec8fff-5db2-481e-9e87-cd444528be1e_h86ty19vdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:17 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b Nov 06 18:44:17 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:17 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ec8fff-5db2-481e-9e87-cd444528be1e_h86ty19vdevstack@QuobyteHD Nov 06 18:44:17 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:17 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b85855a9-fd40-4000-810f-5ceb9f3ae1f4 1073741824" returned: 0 in 0.504s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b85855a9-fd40-4000-810f-5ceb9f3ae1f4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:17 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b85855a9-fd40-4000-810f-5ceb9f3ae1f4 Nov 06 18:44:17 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:17 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b" returned: 0 in 0.489s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a6185df-926d-49fb-a894-feddb5832e7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d151a93-1c59-40a7-acbf-25073e3817a9]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:17 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ec8fff-5db2-481e-9e87-cd444528be1e_h86ty19vdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Temporary image c9ec8fff-5db2-481e-9e87-cd444528be1e is fetched for user 11b65ead679f42e29c31f43effd9a79e. {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 18:44:17 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d Nov 06 18:44:17 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a724e9-f20c-4a27-b542-49826d40ab29]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ec8fff-5db2-481e-9e87-cd444528be1e_h86ty19vdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:17 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b85855a9-fd40-4000-810f-5ceb9f3ae1f4" returned: 0 in 0.257s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.967s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1669306192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109587c4-e974-47f4-aa22-4293fde2473b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='439ca504f60349ff86a10ac4b2a75496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:11Z,use_quota=True,user_id='0f9d5a4b1cbc448baaaf0e572cd53837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(022ed6dc-c8e5-44b2-afc8-e6b639c0a89f),volume_type_id=022ed6dc-c8e5-44b2-afc8-e6b639c0a89f)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Creating volume 109587c4-e974-47f4-aa22-4293fde2473b {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:44:17 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-109587c4-e974-47f4-aa22-4293fde2473b 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:17 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-109587c4-e974-47f4-aa22-4293fde2473b 1073741824 Nov 06 18:44:17 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (652c1675-49fe-471d-af16-6fc7fc8436e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b85855a9-fd40-4000-810f-5ceb9f3ae1f4', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37166a88-634c-4758-b7ba-d9deb7bb166c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:17 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Volume volume-b85855a9-fd40-4000-810f-5ceb9f3ae1f4 (b85855a9-fd40-4000-810f-5ceb9f3ae1f4): created successfully Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37166a88-634c-4758-b7ba-d9deb7bb166c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:17 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ec8fff-5db2-481e-9e87-cd444528be1e_h86ty19vdevstack@QuobyteHD Nov 06 18:44:17 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Flow 'volume_create_manager' (fd61fbec-b8d7-4ee4-bc07-0044f41a18f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:17 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c7ba75b5-6bef-40c0-8bd6-00c326d06d14 tempest-TestInstancesWithCinderVolumes-1982719473 None] Created volume successfully. Nov 06 18:44:17 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ec8fff-5db2-481e-9e87-cd444528be1e_h86ty19vdevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:18 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d" returned: 0 in 0.745s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:18 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b Nov 06 18:44:18 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:18 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-109587c4-e974-47f4-aa22-4293fde2473b 1073741824" returned: 0 in 0.576s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-109587c4-e974-47f4-aa22-4293fde2473b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:18 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-109587c4-e974-47f4-aa22-4293fde2473b Nov 06 18:44:18 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:18 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-109587c4-e974-47f4-aa22-4293fde2473b" returned: 0 in 0.247s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.443s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2140983986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b70858-8a68-4989-9091-783cd6163b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79585b40d71840bd8b89880ec756cb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:10Z,use_quota=True,user_id='11b65ead679f42e29c31f43effd9a79e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea5ac385-e9b6-4e3a-84ad-23d07b89773b),volume_type_id=ea5ac385-e9b6-4e3a-84ad-23d07b89773b)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Creating volume 67b70858-8a68-4989-9091-783cd6163b93 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:44:18 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-67b70858-8a68-4989-9091-783cd6163b93 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:18 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b54ab4-dc51-4e40-9489-b190e9fe69ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-109587c4-e974-47f4-aa22-4293fde2473b', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:18 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-67b70858-8a68-4989-9091-783cd6163b93 1073741824 Nov 06 18:44:18 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a56102-da3f-46f0-a576-0f5e42cb122a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b" returned: 0 in 0.365s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:18 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Volume volume-109587c4-e974-47f4-aa22-4293fde2473b (109587c4-e974-47f4-aa22-4293fde2473b): created successfully Nov 06 18:44:18 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b Nov 06 18:44:18 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a56102-da3f-46f0-a576-0f5e42cb122a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Flow 'volume_create_manager' (7a3835d3-b673-446b-ba73-57b2899a14a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:18 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-0972c9a9-129f-4498-89e5-723a787f07d0 tempest-VolumeTypesAccessTest-412751224 None] Created volume successfully. Nov 06 18:44:18 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d.e9a30a2e-253f-40b4-86bd-b2624b526b1b" returned: 0 in 0.261s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-e9a30a2e-253f-40b4-86bd-b2624b526b1b" released by "_delete_snapshot" :: held 1.978s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-5a6185df-926d-49fb-a894-feddb5832e7d" released by "delete_snapshot" :: held 2.055s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] Acquiring lock "cinder-109587c4-e974-47f4-aa22-4293fde2473b-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] Lock "cinder-109587c4-e974-47f4-aa22-4293fde2473b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Created reservations ['a33d28f6-f97e-4839-8913-3b1a1ce1c139', 'b1958da0-0238-4c93-ac0c-045289bed088', 'd9235e19-3940-403e-9a21-5f257a548c9e', 'fc554ae5-d633-4df4-a0e8-13ddd97d8d46'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] Acquiring lock "cinder-quobyte-109587c4-e974-47f4-aa22-4293fde2473b" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] Lock "cinder-quobyte-109587c4-e974-47f4-aa22-4293fde2473b" acquired by "delete_volume" :: waited 0.025s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[d681b3d1-f81b-4e6e-9d59-76ce4a83eb5e]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-109587c4-e974-47f4-aa22-4293fde2473b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:18 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-67b70858-8a68-4989-9091-783cd6163b93 1073741824" returned: 0 in 0.533s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:18 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Delete snapshot completed successfully. Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-e9a30a2e-253f-40b4-86bd-b2624b526b1b-delete_snapshot" released by "delete_snapshot" :: held 2.303s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Snapshots deleted, issuing volume delete {{(pid=86794) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 06 18:44:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "cinder-quobyte-5a6185df-926d-49fb-a894-feddb5832e7d" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-5a6185df-926d-49fb-a894-feddb5832e7d" acquired by "delete_volume" :: waited 0.018s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-67b70858-8a68-4989-9091-783cd6163b93 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f550cf-29d7-49af-85b1-d1fa3611b186]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:19 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-109587c4-e974-47f4-aa22-4293fde2473b Nov 06 18:44:19 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-67b70858-8a68-4989-9091-783cd6163b93 Nov 06 18:44:19 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:19 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:19 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d Nov 06 18:44:19 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:19 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-67b70858-8a68-4989-9091-783cd6163b93" returned: 0 in 0.261s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Attempting download of c9ec8fff-5db2-481e-9e87-cd444528be1e ((None, [{'url': 'file:///opt/stack/data/glance/images/c9ec8fff-5db2-481e-9e87-cd444528be1e', 'metadata': {}}])) to volume 67b70858-8a68-4989-9091-783cd6163b93. {{(pid=86794) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 18:44:19 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-109587c4-e974-47f4-aa22-4293fde2473b" returned: 0 in 0.406s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-109587c4-e974-47f4-aa22-4293fde2473b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:19 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-109587c4-e974-47f4-aa22-4293fde2473b Nov 06 18:44:19 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[920fce0c-16ef-4e82-9199-66e57db2aadd]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9ec8fff-5db2-481e-9e87-cd444528be1e_0d9nsyla {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:19 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d" returned: 0 in 0.400s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:19 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d Nov 06 18:44:19 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:19 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9ec8fff-5db2-481e-9e87-cd444528be1e_0d9nsyla Nov 06 18:44:19 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:19 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-109587c4-e974-47f4-aa22-4293fde2473b" returned: 0 in 0.269s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] Lock "cinder-quobyte-109587c4-e974-47f4-aa22-4293fde2473b" released by "delete_volume" :: held 0.727s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:19 devstack cinder-volume[86794]: WARNING cinder.quota [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1385687343 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1385687343, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:44:19 devstack cinder-volume[86794]: WARNING cinder.quota [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1385687343 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1385687343, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] Created reservations ['7c06ce81-cbaa-4089-b694-9d7b0c8ab27f', '2ebab208-e750-4e48-9a20-5cf335648dc4', 'e24bbda3-a1a2-48e4-b5d1-db77b9607184', 'fea97e1d-6768-456b-b002-938716bfd98f'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:44:19 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5a6185df-926d-49fb-a894-feddb5832e7d" returned: 0 in 0.261s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:19 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9ec8fff-5db2-481e-9e87-cd444528be1e_0d9nsyla" returned: 0 in 0.352s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9ec8fff-5db2-481e-9e87-cd444528be1e_0d9nsyla {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-5a6185df-926d-49fb-a894-feddb5832e7d" released by "delete_volume" :: held 0.749s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:19 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:44:19 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Created reservations ['54f40a67-a734-413e-923f-7dcef0978a94', '78c45431-dcaf-434d-8267-e0d69669ed18', '5942c596-15b1-4308-8a02-8be4cdf4eebc', '8b4708db-2e6b-444a-952c-0628f2c1c38c'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:44:19 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9ec8fff-5db2-481e-9e87-cd444528be1e_0d9nsyla Nov 06 18:44:19 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:19 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:44:19 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:20 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.362s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:44:20 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] Deleted volume successfully. Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3426a608-a3ab-4141-9678-2f4b98a85551 tempest-VolumeTypesAccessTest-412751224 None] Lock "cinder-109587c4-e974-47f4-aa22-4293fde2473b-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:20 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9ec8fff-5db2-481e-9e87-cd444528be1e_0d9nsyla" returned: 1 in 0.469s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9ec8fff-5db2-481e-9e87-cd444528be1e_0d9nsyla' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cde37a-c82d-409a-bbf8-da0f2d96ffad]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ec8fff-5db2-481e-9e87-cd444528be1e_h86ty19vdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:20 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.318s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:44:20 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Deleted volume successfully. Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ac116737-0aa8-4c3c-832b-27f9ea522316 tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "cinder-36e1ab71-75df-486a-bde2-d0a498bf5aa9-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ac116737-0aa8-4c3c-832b-27f9ea522316 tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-36e1ab71-75df-486a-bde2-d0a498bf5aa9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a20bb90-a83b-4afe-97a5-29ebbf967a5c tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-5a6185df-926d-49fb-a894-feddb5832e7d-delete_volume" released by "delete_volume" :: held 3.688s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ac116737-0aa8-4c3c-832b-27f9ea522316 tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "cinder-quobyte-36e1ab71-75df-486a-bde2-d0a498bf5aa9" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ac116737-0aa8-4c3c-832b-27f9ea522316 tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-36e1ab71-75df-486a-bde2-d0a498bf5aa9" acquired by "delete_volume" :: waited 0.017s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:20 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ec8fff-5db2-481e-9e87-cd444528be1e_h86ty19vdevstack@QuobyteHD Nov 06 18:44:20 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[8714795f-d54c-4a91-932b-03e50f960dba]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ac116737-0aa8-4c3c-832b-27f9ea522316 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36e1ab71-75df-486a-bde2-d0a498bf5aa9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:20 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36e1ab71-75df-486a-bde2-d0a498bf5aa9 Nov 06 18:44:20 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:20 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ec8fff-5db2-481e-9e87-cd444528be1e_h86ty19vdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] c9ec8fff-5db2-481e-9e87-cd444528be1e was qcow2, converting to qcow2 {{(pid=86794) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c9ec8fff-5db2-481e-9e87-cd444528be1e_h86ty19vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-67b70858-8a68-4989-9091-783cd6163b93 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:20 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c9ec8fff-5db2-481e-9e87-cd444528be1e_h86ty19vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-67b70858-8a68-4989-9091-783cd6163b93 Nov 06 18:44:20 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:20 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ac116737-0aa8-4c3c-832b-27f9ea522316 tempest-VolumesDeleteCascade-306483724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36e1ab71-75df-486a-bde2-d0a498bf5aa9" returned: 0 in 0.406s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ac116737-0aa8-4c3c-832b-27f9ea522316 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36e1ab71-75df-486a-bde2-d0a498bf5aa9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:20 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36e1ab71-75df-486a-bde2-d0a498bf5aa9 Nov 06 18:44:20 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:21 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ac116737-0aa8-4c3c-832b-27f9ea522316 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36e1ab71-75df-486a-bde2-d0a498bf5aa9" returned: 0 in 0.267s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ac116737-0aa8-4c3c-832b-27f9ea522316 tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-quobyte-36e1ab71-75df-486a-bde2-d0a498bf5aa9" released by "delete_volume" :: held 0.733s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:21 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-ac116737-0aa8-4c3c-832b-27f9ea522316 tempest-VolumesDeleteCascade-306483724 None] Created reservations ['46f94b49-e9ff-4a1f-a959-9a30bdc0ff1a', '0a5c6ad9-c2d9-4212-bf76-cb05e0a38432', 'b8d0d8ea-8eb3-4a50-b551-382f473d2726', '339b782d-a194-4557-8526-62197dcbc58b'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:44:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ac116737-0aa8-4c3c-832b-27f9ea522316 tempest-VolumesDeleteCascade-306483724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ac116737-0aa8-4c3c-832b-27f9ea522316 tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ac116737-0aa8-4c3c-832b-27f9ea522316 tempest-VolumesDeleteCascade-306483724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ac116737-0aa8-4c3c-832b-27f9ea522316 tempest-VolumesDeleteCascade-306483724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ac116737-0aa8-4c3c-832b-27f9ea522316 tempest-VolumesDeleteCascade-306483724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ac116737-0aa8-4c3c-832b-27f9ea522316 tempest-VolumesDeleteCascade-306483724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:21 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:44:21 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:21 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ac116737-0aa8-4c3c-832b-27f9ea522316 tempest-VolumesDeleteCascade-306483724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.329s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:21 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-ac116737-0aa8-4c3c-832b-27f9ea522316 tempest-VolumesDeleteCascade-306483724 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:44:21 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-ac116737-0aa8-4c3c-832b-27f9ea522316 tempest-VolumesDeleteCascade-306483724 None] Deleted volume successfully. Nov 06 18:44:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ac116737-0aa8-4c3c-832b-27f9ea522316 tempest-VolumesDeleteCascade-306483724 None] Lock "cinder-36e1ab71-75df-486a-bde2-d0a498bf5aa9-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:23 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c9ec8fff-5db2-481e-9e87-cd444528be1e_h86ty19vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-67b70858-8a68-4989-9091-783cd6163b93" returned: 0 in 2.588s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c9ec8fff-5db2-481e-9e87-cd444528be1e_h86ty19vdevstack@QuobyteHD, size 112.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-67b70858-8a68-4989-9091-783cd6163b93 {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:44:23 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Converted 112.00 MB image at 43.26 MB/s Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-67b70858-8a68-4989-9091-783cd6163b93 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:23 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-67b70858-8a68-4989-9091-783cd6163b93 1G Nov 06 18:44:23 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Flow 'volume_create_manager' (2729d4de-19ad-474c-ab25-42b987dc8a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f57e0bea-7657-4726-bdf2-27e56dc91c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f57e0bea-7657-4726-bdf2-27e56dc91c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1375471786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afda3c88-b6f9-439c-9d77-f4da7e1d9666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bdeb192392c4d738b219fe2880878a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:23Z,use_quota=True,user_id='1235235abfaa4f51b52b8d7997ed08b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d20501-4aea-485a-a4b1-6d83adf47265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d20501-4aea-485a-a4b1-6d83adf47265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca604c5f-fd4a-4e9a-a827-0f17bbda1dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca604c5f-fd4a-4e9a-a827-0f17bbda1dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afda3c88-b6f9-439c-9d77-f4da7e1d9666', 'volume_name': 'volume-afda3c88-b6f9-439c-9d77-f4da7e1d9666', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b547bf0c-3aaa-47c8-92a4-1e48fa612346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b547bf0c-3aaa-47c8-92a4-1e48fa612346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b160fe17-8571-400d-87fb-5aec496ebc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:23 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Volume afda3c88-b6f9-439c-9d77-f4da7e1d9666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afda3c88-b6f9-439c-9d77-f4da7e1d9666', 'volume_size': 1} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1375471786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afda3c88-b6f9-439c-9d77-f4da7e1d9666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bdeb192392c4d738b219fe2880878a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:23Z,use_quota=True,user_id='1235235abfaa4f51b52b8d7997ed08b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Creating volume afda3c88-b6f9-439c-9d77-f4da7e1d9666 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:44:23 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-afda3c88-b6f9-439c-9d77-f4da7e1d9666 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:23 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-afda3c88-b6f9-439c-9d77-f4da7e1d9666 1073741824 Nov 06 18:44:23 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:23 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-67b70858-8a68-4989-9091-783cd6163b93 1G" returned: 0 in 0.539s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Downloaded image c9ec8fff-5db2-481e-9e87-cd444528be1e ((None, [{'url': 'file:///opt/stack/data/glance/images/c9ec8fff-5db2-481e-9e87-cd444528be1e', 'metadata': {}}])) to volume 67b70858-8a68-4989-9091-783cd6163b93 successfully. {{(pid=86794) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Temporary image c9ec8fff-5db2-481e-9e87-cd444528be1e for user 11b65ead679f42e29c31f43effd9a79e is deleted. {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Marking volume 67b70858-8a68-4989-9091-783cd6163b93 as bootable. {{(pid=86794) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Copying metadata from image c9ec8fff-5db2-481e-9e87-cd444528be1e to 67b70858-8a68-4989-9091-783cd6163b93. {{(pid=86794) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Creating volume glance metadata for volume 67b70858-8a68-4989-9091-783cd6163b93 backed by image c9ec8fff-5db2-481e-9e87-cd444528be1e with: {'image_id': 'c9ec8fff-5db2-481e-9e87-cd444528be1e', 'image_name': 'tempest-scenario-img--1815322444', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86794) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069992ce-73ad-402f-86cf-98becfde1dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67b70858-8a68-4989-9091-783cd6163b93', 'volume_size': 1, 'image_id': 'c9ec8fff-5db2-481e-9e87-cd444528be1e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9ec8fff-5db2-481e-9e87-cd444528be1e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1815322444', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '79585b40d71840bd8b89880ec756cb2d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c9ec8fff-5db2-481e-9e87-cd444528be1e', 'created_at': datetime.datetime(2026, 11, 6, 17, 44, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 44, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9ec8fff-5db2-481e-9e87-cd444528be1e/file', 'properties': {}}, 'image_service': }' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18bff23-94a8-4a36-9c05-cd913da7a821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:23 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Volume volume-67b70858-8a68-4989-9091-783cd6163b93 (67b70858-8a68-4989-9091-783cd6163b93): created successfully Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18bff23-94a8-4a36-9c05-cd913da7a821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:23 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Flow 'volume_create_manager' (dd82b92b-e057-46a1-93cf-dd898fec4247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:24 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-121f6395-b75b-4851-b918-323a65c4605d tempest-TestInstancesWithCinderVolumes-1982719473 None] Created volume successfully. Nov 06 18:44:24 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-afda3c88-b6f9-439c-9d77-f4da7e1d9666 1073741824" returned: 0 in 0.650s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-afda3c88-b6f9-439c-9d77-f4da7e1d9666 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:24 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-afda3c88-b6f9-439c-9d77-f4da7e1d9666 Nov 06 18:44:24 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:24 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-afda3c88-b6f9-439c-9d77-f4da7e1d9666" returned: 0 in 0.301s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:44:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b160fe17-8571-400d-87fb-5aec496ebc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afda3c88-b6f9-439c-9d77-f4da7e1d9666', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce795fa0-5e0e-4da1-838d-53319633b6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:24 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Volume volume-afda3c88-b6f9-439c-9d77-f4da7e1d9666 (afda3c88-b6f9-439c-9d77-f4da7e1d9666): created successfully Nov 06 18:44:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce795fa0-5e0e-4da1-838d-53319633b6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Flow 'volume_create_manager' (2729d4de-19ad-474c-ab25-42b987dc8a7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:24 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-7510e82e-bd97-481b-b056-dc2edf5c073e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Created volume successfully. Nov 06 18:44:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-22dddede-f928-448f-9975-09f872afd2b7 req-0ac817ec-4d03-48b0-9b5a-bd4caa82de3a tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-22dddede-f928-448f-9975-09f872afd2b7 req-0ac817ec-4d03-48b0-9b5a-bd4caa82de3a tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-22dddede-f928-448f-9975-09f872afd2b7 req-0ac817ec-4d03-48b0-9b5a-bd4caa82de3a tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-22dddede-f928-448f-9975-09f872afd2b7 req-0ac817ec-4d03-48b0-9b5a-bd4caa82de3a tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-afda3c88-b6f9-439c-9d77-f4da7e1d9666', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10cf5c80-5c5e-4c92-8b75-d90eb81c8e7b', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:44:26 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-22dddede-f928-448f-9975-09f872afd2b7 req-0ac817ec-4d03-48b0-9b5a-bd4caa82de3a tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] attachment_update completed successfully. Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Flow 'volume_create_manager' (acbf819c-0b3d-4402-ad18-b0a1af63384f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e19358-fe22-4ae0-9dfb-65eb597b4ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e19358-fe22-4ae0-9dfb-65eb597b4ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-616846081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca6bad1-bf69-47d8-ba09-2073e18ea6b3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='034d99ffb5614dafa26e0f668401247b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:27Z,use_quota=True,user_id='74ddfdab2949404d8297e23626514f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f22c03c0-909c-4657-b3bc-f84968b3fa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f22c03c0-909c-4657-b3bc-f84968b3fa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b665ded3-52f9-4d47-a3bb-a49943e1fa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b665ded3-52f9-4d47-a3bb-a49943e1fa1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ca6bad1-bf69-47d8-ba09-2073e18ea6b3', 'volume_name': 'volume-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5727f6-f5ca-4dbe-8657-49445e510527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5727f6-f5ca-4dbe-8657-49445e510527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48516a98-b87a-4411-a408-1026190394b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:27 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Volume 2ca6bad1-bf69-47d8-ba09-2073e18ea6b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3', 'volume_size': 1} Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-616846081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca6bad1-bf69-47d8-ba09-2073e18ea6b3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='034d99ffb5614dafa26e0f668401247b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:27Z,use_quota=True,user_id='74ddfdab2949404d8297e23626514f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Creating volume 2ca6bad1-bf69-47d8-ba09-2073e18ea6b3 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:44:27 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:27 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3 1073741824 Nov 06 18:44:27 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:27 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3 1073741824" returned: 0 in 0.605s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:28 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3 Nov 06 18:44:28 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:28 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3" returned: 0 in 0.394s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:44:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48516a98-b87a-4411-a408-1026190394b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54501cea-da29-4430-a5ae-749669ad76d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:28 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Volume volume-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3 (2ca6bad1-bf69-47d8-ba09-2073e18ea6b3): created successfully Nov 06 18:44:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54501cea-da29-4430-a5ae-749669ad76d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Flow 'volume_create_manager' (acbf819c-0b3d-4402-ad18-b0a1af63384f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:28 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-acb633c5-e030-4254-be32-f551f899bedb tempest-VolumesGetTest-1608161745 None] Created volume successfully. Nov 06 18:44:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-5f5b8767-bcd5-475e-9381-d2dd3dc668e4 req-7dafc107-8c6d-4dbe-a782-3ee4860745d8 tempest-TestInstancesWithCinderVolumes-1982719473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-5f5b8767-bcd5-475e-9381-d2dd3dc668e4 req-7dafc107-8c6d-4dbe-a782-3ee4860745d8 tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-5f5b8767-bcd5-475e-9381-d2dd3dc668e4 req-7dafc107-8c6d-4dbe-a782-3ee4860745d8 tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-5f5b8767-bcd5-475e-9381-d2dd3dc668e4 req-7dafc107-8c6d-4dbe-a782-3ee4860745d8 tempest-TestInstancesWithCinderVolumes-1982719473 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-67b70858-8a68-4989-9091-783cd6163b93', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a3d841a-5ec9-4f9c-bbe0-f5098b9ebb96', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:44:28 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-5f5b8767-bcd5-475e-9381-d2dd3dc668e4 req-7dafc107-8c6d-4dbe-a782-3ee4860745d8 tempest-TestInstancesWithCinderVolumes-1982719473 None] attachment_update completed successfully. Nov 06 18:44:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:44:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:29 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:44:29 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:29 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.515s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:44:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:44:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 29 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:44:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Flow 'volume_create_manager' (bde0ea55-f7a5-453a-9e03-74251a5436e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (985d3978-ffae-4ffe-9d90-7a0703ea857d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (985d3978-ffae-4ffe-9d90-7a0703ea857d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-667648024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb9adc6-9884-4ec6-86fc-d855f3495505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70e4361c6854d4694830911c27ec3d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:30Z,use_quota=True,user_id='f6184b7799104a6381f7c03c6d5eff65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d01940-9075-4791-ad83-0785258f4b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d01940-9075-4791-ad83-0785258f4b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a88a9a2a-3c59-4435-b2db-cf5857b30aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a88a9a2a-3c59-4435-b2db-cf5857b30aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb9adc6-9884-4ec6-86fc-d855f3495505', 'volume_name': 'volume-1eb9adc6-9884-4ec6-86fc-d855f3495505', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a83589-5352-4ba0-b90c-1f9ea9638d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a83589-5352-4ba0-b90c-1f9ea9638d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af71ff7-a326-4ce6-b78a-992ce6d47d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:30 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Volume 1eb9adc6-9884-4ec6-86fc-d855f3495505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb9adc6-9884-4ec6-86fc-d855f3495505', 'volume_size': 1} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-667648024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb9adc6-9884-4ec6-86fc-d855f3495505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70e4361c6854d4694830911c27ec3d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:30Z,use_quota=True,user_id='f6184b7799104a6381f7c03c6d5eff65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Creating volume 1eb9adc6-9884-4ec6-86fc-d855f3495505 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:44:30 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:44:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1eb9adc6-9884-4ec6-86fc-d855f3495505 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:30 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1eb9adc6-9884-4ec6-86fc-d855f3495505 1073741824 Nov 06 18:44:30 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:31 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-708d4c6e-1bd8-4d3c-bdd0-e2fe13fa90ec req-64d3a155-3736-4c39-a971-a654d01d7d3e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Terminate volume connection completed successfully. Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-708d4c6e-1bd8-4d3c-bdd0-e2fe13fa90ec req-64d3a155-3736-4c39-a971-a654d01d7d3e tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Deleting attachment 10cf5c80-5c5e-4c92-8b75-d90eb81c8e7b. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Flow 'volume_create_manager' (9c7d6cd4-9964-4d7d-a869-a766fbbcf761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5906680-363f-4c68-9f24-734e0aa3e065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5906680-363f-4c68-9f24-734e0aa3e065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-310906628',display_name='tempest-VolumesGetTest-Volume-1039844698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e0c579-61e9-4519-bcd5-d3fd3554e340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034d99ffb5614dafa26e0f668401247b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:31Z,use_quota=True,user_id='74ddfdab2949404d8297e23626514f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b700fd-1dc6-417f-be05-15e4744a5ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:31 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b700fd-1dc6-417f-be05-15e4744a5ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42dfb1c2-6f8a-4e92-8d57-3ba1059ed7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42dfb1c2-6f8a-4e92-8d57-3ba1059ed7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0e0c579-61e9-4519-bcd5-d3fd3554e340', 'volume_name': 'volume-c0e0c579-61e9-4519-bcd5-d3fd3554e340', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad6edad-0fe5-4720-bbc2-54710a811d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad6edad-0fe5-4720-bbc2-54710a811d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f591af8-e671-4704-b55a-9a72913f07f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:31 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Volume c0e0c579-61e9-4519-bcd5-d3fd3554e340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0e0c579-61e9-4519-bcd5-d3fd3554e340', 'volume_size': 1} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1eb9adc6-9884-4ec6-86fc-d855f3495505 1073741824" returned: 0 in 0.720s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1eb9adc6-9884-4ec6-86fc-d855f3495505 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:31 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1eb9adc6-9884-4ec6-86fc-d855f3495505 Nov 06 18:44:31 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:31 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1eb9adc6-9884-4ec6-86fc-d855f3495505" returned: 0 in 0.316s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.364s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-310906628',display_name='tempest-VolumesGetTest-Volume-1039844698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e0c579-61e9-4519-bcd5-d3fd3554e340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034d99ffb5614dafa26e0f668401247b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:31Z,use_quota=True,user_id='74ddfdab2949404d8297e23626514f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Creating volume c0e0c579-61e9-4519-bcd5-d3fd3554e340 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:44:31 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0e0c579-61e9-4519-bcd5-d3fd3554e340 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af71ff7-a326-4ce6-b78a-992ce6d47d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb9adc6-9884-4ec6-86fc-d855f3495505', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:31 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0e0c579-61e9-4519-bcd5-d3fd3554e340 1073741824 Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf761422-ae63-47d8-8396-d5bfc215126f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:31 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:31 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Volume volume-1eb9adc6-9884-4ec6-86fc-d855f3495505 (1eb9adc6-9884-4ec6-86fc-d855f3495505): created successfully Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf761422-ae63-47d8-8396-d5bfc215126f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Flow 'volume_create_manager' (bde0ea55-f7a5-453a-9e03-74251a5436e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:31 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-0e7acfac-da27-49c1-aee8-ca43d2baf45b tempest-VolumesListAdminTestJSON-77557207 None] Created volume successfully. Nov 06 18:44:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ae164285-190c-432f-ad4d-721c51c35d6d tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Acquiring lock "cinder-afda3c88-b6f9-439c-9d77-f4da7e1d9666-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ae164285-190c-432f-ad4d-721c51c35d6d tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Lock "cinder-afda3c88-b6f9-439c-9d77-f4da7e1d9666-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ae164285-190c-432f-ad4d-721c51c35d6d tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Acquiring lock "cinder-quobyte-afda3c88-b6f9-439c-9d77-f4da7e1d9666" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ae164285-190c-432f-ad4d-721c51c35d6d tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Lock "cinder-quobyte-afda3c88-b6f9-439c-9d77-f4da7e1d9666" acquired by "delete_volume" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:32 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4d0225-57b5-4d15-becf-be1d30158594]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae164285-190c-432f-ad4d-721c51c35d6d tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-afda3c88-b6f9-439c-9d77-f4da7e1d9666 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:32 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-afda3c88-b6f9-439c-9d77-f4da7e1d9666 Nov 06 18:44:32 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:32 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0e0c579-61e9-4519-bcd5-d3fd3554e340 1073741824" returned: 0 in 1.014s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0e0c579-61e9-4519-bcd5-d3fd3554e340 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:32 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0e0c579-61e9-4519-bcd5-d3fd3554e340 Nov 06 18:44:32 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:33 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae164285-190c-432f-ad4d-721c51c35d6d tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-afda3c88-b6f9-439c-9d77-f4da7e1d9666" returned: 0 in 0.888s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae164285-190c-432f-ad4d-721c51c35d6d tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-afda3c88-b6f9-439c-9d77-f4da7e1d9666 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:33 devstack sudo[100929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-afda3c88-b6f9-439c-9d77-f4da7e1d9666 Nov 06 18:44:33 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:33 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0e0c579-61e9-4519-bcd5-d3fd3554e340" returned: 0 in 0.545s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f591af8-e671-4704-b55a-9a72913f07f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0e0c579-61e9-4519-bcd5-d3fd3554e340', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b29270-9ad2-4aa9-bffb-0d6bfb9d1279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Flow 'volume_create_manager' (73421103-3d4a-4071-8454-f4b85a53626d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3afceddb-09b2-4bc5-8089-9302aea2c89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:33 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Volume volume-c0e0c579-61e9-4519-bcd5-d3fd3554e340 (c0e0c579-61e9-4519-bcd5-d3fd3554e340): created successfully Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b29270-9ad2-4aa9-bffb-0d6bfb9d1279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Flow 'volume_create_manager' (9c7d6cd4-9964-4d7d-a869-a766fbbcf761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3afceddb-09b2-4bc5-8089-9302aea2c89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1851029876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78894c65-75a9-406f-88a8-6da3d6531ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70e4361c6854d4694830911c27ec3d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:33Z,use_quota=True,user_id='f6184b7799104a6381f7c03c6d5eff65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaebc7c3-5c2e-4d00-b87d-ec33ca097e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaebc7c3-5c2e-4d00-b87d-ec33ca097e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f24cd2-7277-4b91-abd0-99b5d0e5375d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f24cd2-7277-4b91-abd0-99b5d0e5375d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78894c65-75a9-406f-88a8-6da3d6531ddc', 'volume_name': 'volume-78894c65-75a9-406f-88a8-6da3d6531ddc', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be4831a-9740-4a8f-8a55-134e8f655836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be4831a-9740-4a8f-8a55-134e8f655836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b283a8f3-c0df-468e-be08-ad8c7f65e5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:33 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:33 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Volume 78894c65-75a9-406f-88a8-6da3d6531ddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78894c65-75a9-406f-88a8-6da3d6531ddc', 'volume_size': 1} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1851029876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78894c65-75a9-406f-88a8-6da3d6531ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70e4361c6854d4694830911c27ec3d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:33Z,use_quota=True,user_id='f6184b7799104a6381f7c03c6d5eff65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Creating volume 78894c65-75a9-406f-88a8-6da3d6531ddc {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:44:33 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-78894c65-75a9-406f-88a8-6da3d6531ddc 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:33 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-31e52eb8-67cc-493c-b97f-16eef7642ca0 tempest-VolumesGetTest-1608161745 None] Created volume successfully. Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae164285-190c-432f-ad4d-721c51c35d6d tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-afda3c88-b6f9-439c-9d77-f4da7e1d9666" returned: 0 in 0.525s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:33 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-78894c65-75a9-406f-88a8-6da3d6531ddc 1073741824 Nov 06 18:44:33 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ae164285-190c-432f-ad4d-721c51c35d6d tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Lock "cinder-quobyte-afda3c88-b6f9-439c-9d77-f4da7e1d9666" released by "delete_volume" :: held 1.522s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:33 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-ae164285-190c-432f-ad4d-721c51c35d6d tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Created reservations ['e159db53-ad97-4f33-8d40-4e57fcee4a0e', 'e2f5f1dd-acfe-4fd9-a18a-a65aeaa4bd37', '05cee16f-8b95-402c-9bf5-999fa4dc4353', 'b8449dd3-98c1-422c-9849-aeb726d8c702'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:44:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ae164285-190c-432f-ad4d-721c51c35d6d tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ae164285-190c-432f-ad4d-721c51c35d6d tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ae164285-190c-432f-ad4d-721c51c35d6d tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ae164285-190c-432f-ad4d-721c51c35d6d tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ae164285-190c-432f-ad4d-721c51c35d6d tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae164285-190c-432f-ad4d-721c51c35d6d tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:34 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:44:34 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:34 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae164285-190c-432f-ad4d-721c51c35d6d tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.349s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:34 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-ae164285-190c-432f-ad4d-721c51c35d6d tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:44:34 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-ae164285-190c-432f-ad4d-721c51c35d6d tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Deleted volume successfully. Nov 06 18:44:34 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:34 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ae164285-190c-432f-ad4d-721c51c35d6d tempest-TestServerVolumeAttachScenarioOldVersion-66011693 None] Lock "cinder-afda3c88-b6f9-439c-9d77-f4da7e1d9666-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-78894c65-75a9-406f-88a8-6da3d6531ddc 1073741824" returned: 0 in 0.722s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-78894c65-75a9-406f-88a8-6da3d6531ddc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:34 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-78894c65-75a9-406f-88a8-6da3d6531ddc Nov 06 18:44:34 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:34 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-656ba506-c8fd-41bc-8446-eaa3487aaa94 tempest-VolumesGetTest-1608161745 None] Acquiring lock "cinder-c0e0c579-61e9-4519-bcd5-d3fd3554e340-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:34 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-656ba506-c8fd-41bc-8446-eaa3487aaa94 tempest-VolumesGetTest-1608161745 None] Lock "cinder-c0e0c579-61e9-4519-bcd5-d3fd3554e340-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:35 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-78894c65-75a9-406f-88a8-6da3d6531ddc" returned: 0 in 0.456s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:44:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b283a8f3-c0df-468e-be08-ad8c7f65e5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78894c65-75a9-406f-88a8-6da3d6531ddc', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d67d4a1-0fad-41dd-b3eb-d1ab70cd2a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:35 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-656ba506-c8fd-41bc-8446-eaa3487aaa94 tempest-VolumesGetTest-1608161745 None] Acquiring lock "cinder-quobyte-c0e0c579-61e9-4519-bcd5-d3fd3554e340" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:35 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-656ba506-c8fd-41bc-8446-eaa3487aaa94 tempest-VolumesGetTest-1608161745 None] Lock "cinder-quobyte-c0e0c579-61e9-4519-bcd5-d3fd3554e340" acquired by "delete_volume" :: waited 0.047s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:35 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Volume volume-78894c65-75a9-406f-88a8-6da3d6531ddc (78894c65-75a9-406f-88a8-6da3d6531ddc): created successfully Nov 06 18:44:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d67d4a1-0fad-41dd-b3eb-d1ab70cd2a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Flow 'volume_create_manager' (73421103-3d4a-4071-8454-f4b85a53626d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:35 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0d6134-f9e6-49d0-8f30-09c8a9917806]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-656ba506-c8fd-41bc-8446-eaa3487aaa94 tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0e0c579-61e9-4519-bcd5-d3fd3554e340 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:35 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-4d5d84c1-d0ed-42bf-b329-110b68c04fd4 tempest-VolumesListAdminTestJSON-77557207 None] Created volume successfully. Nov 06 18:44:35 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0e0c579-61e9-4519-bcd5-d3fd3554e340 Nov 06 18:44:35 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:36 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-656ba506-c8fd-41bc-8446-eaa3487aaa94 tempest-VolumesGetTest-1608161745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0e0c579-61e9-4519-bcd5-d3fd3554e340" returned: 0 in 0.873s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-656ba506-c8fd-41bc-8446-eaa3487aaa94 tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0e0c579-61e9-4519-bcd5-d3fd3554e340 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:36 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0e0c579-61e9-4519-bcd5-d3fd3554e340 Nov 06 18:44:36 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:36 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-656ba506-c8fd-41bc-8446-eaa3487aaa94 tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0e0c579-61e9-4519-bcd5-d3fd3554e340" returned: 0 in 0.486s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Flow 'volume_create_manager' (eea80e2e-f7b9-4498-a247-4627af0d2eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74cc4af-0983-48b0-82a6-2a96273c8f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-656ba506-c8fd-41bc-8446-eaa3487aaa94 tempest-VolumesGetTest-1608161745 None] Lock "cinder-quobyte-c0e0c579-61e9-4519-bcd5-d3fd3554e340" released by "delete_volume" :: held 1.617s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74cc4af-0983-48b0-82a6-2a96273c8f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-212066444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72aeebc-fe04-4ad3-872a-93ff96075986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70e4361c6854d4694830911c27ec3d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:37Z,use_quota=True,user_id='f6184b7799104a6381f7c03c6d5eff65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb41246-8dac-4c77-9cd1-c93f1a74a2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb41246-8dac-4c77-9cd1-c93f1a74a2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae96afe8-8d44-4eab-95e2-6a78f4e47e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae96afe8-8d44-4eab-95e2-6a78f4e47e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c72aeebc-fe04-4ad3-872a-93ff96075986', 'volume_name': 'volume-c72aeebc-fe04-4ad3-872a-93ff96075986', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17a5ef5-b6b2-4c63-8027-585c48532d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17a5ef5-b6b2-4c63-8027-585c48532d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7e5449-9c5e-4726-9677-e02a977ac493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:36 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Volume c72aeebc-fe04-4ad3-872a-93ff96075986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c72aeebc-fe04-4ad3-872a-93ff96075986', 'volume_size': 1} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-212066444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72aeebc-fe04-4ad3-872a-93ff96075986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70e4361c6854d4694830911c27ec3d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:37Z,use_quota=True,user_id='f6184b7799104a6381f7c03c6d5eff65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Creating volume c72aeebc-fe04-4ad3-872a-93ff96075986 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:44:36 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:44:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c72aeebc-fe04-4ad3-872a-93ff96075986 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:37 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c72aeebc-fe04-4ad3-872a-93ff96075986 1073741824 Nov 06 18:44:37 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:37 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-656ba506-c8fd-41bc-8446-eaa3487aaa94 tempest-VolumesGetTest-1608161745 None] Created reservations ['7763bddd-b116-4988-a111-5c332ecb431d', 'b54ec58b-1af2-4d3e-b805-b8f5f7fc6631', 'a46fb7d3-38a6-4d11-8086-c5385c502210', 'a466effa-7a95-4fb3-adb3-5d21e6ee1f47'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:44:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-656ba506-c8fd-41bc-8446-eaa3487aaa94 tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-656ba506-c8fd-41bc-8446-eaa3487aaa94 tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-656ba506-c8fd-41bc-8446-eaa3487aaa94 tempest-VolumesGetTest-1608161745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-656ba506-c8fd-41bc-8446-eaa3487aaa94 tempest-VolumesGetTest-1608161745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-656ba506-c8fd-41bc-8446-eaa3487aaa94 tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-656ba506-c8fd-41bc-8446-eaa3487aaa94 tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:37 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:44:37 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ee79875a-e40b-441a-8e3b-226fc2c7fcdf tempest-VolumesGetTest-1608161745 None] Acquiring lock "cinder-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ee79875a-e40b-441a-8e3b-226fc2c7fcdf tempest-VolumesGetTest-1608161745 None] Lock "cinder-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ee79875a-e40b-441a-8e3b-226fc2c7fcdf tempest-VolumesGetTest-1608161745 None] Acquiring lock "cinder-quobyte-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:37 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-656ba506-c8fd-41bc-8446-eaa3487aaa94 tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.495s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:37 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-656ba506-c8fd-41bc-8446-eaa3487aaa94 tempest-VolumesGetTest-1608161745 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:44:37 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-656ba506-c8fd-41bc-8446-eaa3487aaa94 tempest-VolumesGetTest-1608161745 None] Deleted volume successfully. Nov 06 18:44:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ee79875a-e40b-441a-8e3b-226fc2c7fcdf tempest-VolumesGetTest-1608161745 None] Lock "cinder-quobyte-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3" acquired by "delete_volume" :: waited 0.093s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-656ba506-c8fd-41bc-8446-eaa3487aaa94 tempest-VolumesGetTest-1608161745 None] Lock "cinder-c0e0c579-61e9-4519-bcd5-d3fd3554e340-delete_volume" released by "delete_volume" :: held 3.042s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:37 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df6b8ae-a8b9-4e0a-a343-d1b0de19b689]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ee79875a-e40b-441a-8e3b-226fc2c7fcdf tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:38 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c72aeebc-fe04-4ad3-872a-93ff96075986 1073741824" returned: 0 in 1.107s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c72aeebc-fe04-4ad3-872a-93ff96075986 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:38 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3 Nov 06 18:44:38 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:38 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c72aeebc-fe04-4ad3-872a-93ff96075986 Nov 06 18:44:38 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:38 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c72aeebc-fe04-4ad3-872a-93ff96075986" returned: 0 in 0.430s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:44:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7e5449-9c5e-4726-9677-e02a977ac493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c72aeebc-fe04-4ad3-872a-93ff96075986', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8fedad8-2176-44af-a5c0-f3e58a44bfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:38 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Volume volume-c72aeebc-fe04-4ad3-872a-93ff96075986 (c72aeebc-fe04-4ad3-872a-93ff96075986): created successfully Nov 06 18:44:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8fedad8-2176-44af-a5c0-f3e58a44bfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Flow 'volume_create_manager' (eea80e2e-f7b9-4498-a247-4627af0d2eb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:38 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-4ebfd9d1-7e4e-4d8d-b908-88ddab363571 tempest-VolumesListAdminTestJSON-77557207 None] Created volume successfully. Nov 06 18:44:38 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ee79875a-e40b-441a-8e3b-226fc2c7fcdf tempest-VolumesGetTest-1608161745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3" returned: 0 in 0.747s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ee79875a-e40b-441a-8e3b-226fc2c7fcdf tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:38 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3 Nov 06 18:44:38 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:39 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ee79875a-e40b-441a-8e3b-226fc2c7fcdf tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3" returned: 0 in 0.356s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ee79875a-e40b-441a-8e3b-226fc2c7fcdf tempest-VolumesGetTest-1608161745 None] Lock "cinder-quobyte-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3" released by "delete_volume" :: held 1.239s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:39 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-ee79875a-e40b-441a-8e3b-226fc2c7fcdf tempest-VolumesGetTest-1608161745 None] Created reservations ['26eb0a9f-a771-42a5-a093-887dc5ecdc31', 'a379284a-3c80-4400-b544-f2d53a91a077', 'ba9b482c-390a-426e-93fb-21af1553888f', '3aaa3641-9082-4498-b3af-6ae2526fe07a'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:44:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ee79875a-e40b-441a-8e3b-226fc2c7fcdf tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ee79875a-e40b-441a-8e3b-226fc2c7fcdf tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ee79875a-e40b-441a-8e3b-226fc2c7fcdf tempest-VolumesGetTest-1608161745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ee79875a-e40b-441a-8e3b-226fc2c7fcdf tempest-VolumesGetTest-1608161745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ee79875a-e40b-441a-8e3b-226fc2c7fcdf tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ee79875a-e40b-441a-8e3b-226fc2c7fcdf tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:39 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:44:39 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:39 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ee79875a-e40b-441a-8e3b-226fc2c7fcdf tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.411s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:39 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-ee79875a-e40b-441a-8e3b-226fc2c7fcdf tempest-VolumesGetTest-1608161745 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:44:39 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-ee79875a-e40b-441a-8e3b-226fc2c7fcdf tempest-VolumesGetTest-1608161745 None] Deleted volume successfully. Nov 06 18:44:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ee79875a-e40b-441a-8e3b-226fc2c7fcdf tempest-VolumesGetTest-1608161745 None] Lock "cinder-2ca6bad1-bf69-47d8-ba09-2073e18ea6b3-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:40 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:44:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Flow 'volume_create_manager' (02f966e2-85ea-4e93-b921-145d602f2ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84c4276-aec3-4404-ae5b-2357a88e9933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84c4276-aec3-4404-ae5b-2357a88e9933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-734360111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d4d864-bacf-4e82-85be-d80c7f073ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034d99ffb5614dafa26e0f668401247b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:41Z,use_quota=True,user_id='74ddfdab2949404d8297e23626514f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ccc04e-4ae4-4001-8640-02ce6e879830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ccc04e-4ae4-4001-8640-02ce6e879830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d337661a-d928-483a-94c5-97f740ea9074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d337661a-d928-483a-94c5-97f740ea9074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20d4d864-bacf-4e82-85be-d80c7f073ce4', 'volume_name': 'volume-20d4d864-bacf-4e82-85be-d80c7f073ce4', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f67a44-ac35-4e1e-a64a-bbdbf251db9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f67a44-ac35-4e1e-a64a-bbdbf251db9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a692d73-c83e-4f10-8cc6-074900f3c376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:41 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Volume 20d4d864-bacf-4e82-85be-d80c7f073ce4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20d4d864-bacf-4e82-85be-d80c7f073ce4', 'volume_size': 1} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-734360111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d4d864-bacf-4e82-85be-d80c7f073ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034d99ffb5614dafa26e0f668401247b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:41Z,use_quota=True,user_id='74ddfdab2949404d8297e23626514f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Creating volume 20d4d864-bacf-4e82-85be-d80c7f073ce4 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:44:41 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:41 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 1073741824 Nov 06 18:44:41 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Flow 'volume_create_manager' (f5925613-a4be-4c4b-99b8-6a36259fdcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e45bc51-a453-4073-ba55-c083c587d9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e45bc51-a453-4073-ba55-c083c587d9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b72eaa3988468c967990ff5783caa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:41Z,use_quota=True,user_id='0b79c7523c87410389e3f43860498961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eda5cc8-1b8c-446f-a037-a7579070b24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eda5cc8-1b8c-446f-a037-a7579070b24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c57194d1-21ee-43cc-b962-dcdc8d6bd8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c57194d1-21ee-43cc-b962-dcdc8d6bd8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375', 'volume_name': 'volume-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6292cb-c42a-4976-9263-3726f8b431ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6292cb-c42a-4976-9263-3726f8b431ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d181ae9-ffe8-40d5-8bdb-bf9ce1dc7f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:41 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Volume 0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375', 'volume_size': 1} Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:41 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 1073741824" returned: 0 in 0.889s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:42 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 Nov 06 18:44:42 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:42 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4" returned: 0 in 0.372s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:44:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.731s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b72eaa3988468c967990ff5783caa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:41Z,use_quota=True,user_id='0b79c7523c87410389e3f43860498961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:44:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Creating volume 0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:44:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:44:42 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:44:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a692d73-c83e-4f10-8cc6-074900f3c376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20d4d864-bacf-4e82-85be-d80c7f073ce4', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:42 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375 1073741824 Nov 06 18:44:42 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164b3c72-64fc-413f-8930-2cfbf20ea973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:42 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Volume volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 (20d4d864-bacf-4e82-85be-d80c7f073ce4): created successfully Nov 06 18:44:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164b3c72-64fc-413f-8930-2cfbf20ea973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Flow 'volume_create_manager' (02f966e2-85ea-4e93-b921-145d602f2ed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:42 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-8d1ec390-b0ac-4aa3-b6e5-5e248d7b29d1 tempest-VolumesGetTest-1608161745 None] Created volume successfully. Nov 06 18:44:43 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375 1073741824" returned: 0 in 0.715s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:43 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375 Nov 06 18:44:43 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:43 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375" returned: 0 in 0.640s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:43 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:44:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d181ae9-ffe8-40d5-8bdb-bf9ce1dc7f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37814fb3-0128-4c03-a096-2d91f5eea5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:43 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:44:43 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Volume volume-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375 (0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375): created successfully Nov 06 18:44:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37814fb3-0128-4c03-a096-2d91f5eea5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Flow 'volume_create_manager' (f5925613-a4be-4c4b-99b8-6a36259fdcfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Flow 'volume_create_manager' (1b35f37f-8f34-47ca-90f5-a487e40194e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:44:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1307b7de-2087-429e-9a18-2b2de120b234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:43 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-3f629809-796f-4400-b799-ffd9c2f92cae tempest-VolumesListAdminTestJSON-963000406 None] Created volume successfully. Nov 06 18:44:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1307b7de-2087-429e-9a18-2b2de120b234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1278334692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59e47c83-b8ba-47e8-b72b-ff02801b8f57,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='034d99ffb5614dafa26e0f668401247b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=20d4d864-bacf-4e82-85be-d80c7f073ce4,status='creating',terminated_at=None,updated_at=2026-11-06T17:44:44Z,use_quota=True,user_id='74ddfdab2949404d8297e23626514f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db943f8e-e49e-4d0e-887c-de79fb33c67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db943f8e-e49e-4d0e-887c-de79fb33c67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d810707e-dca1-424f-80d4-4ca76842fb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d810707e-dca1-424f-80d4-4ca76842fb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '59e47c83-b8ba-47e8-b72b-ff02801b8f57', 'volume_name': 'volume-59e47c83-b8ba-47e8-b72b-ff02801b8f57', 'volume_size': 1, 'source_volid': '20d4d864-bacf-4e82-85be-d80c7f073ce4', 'source_volstatus': 'available'}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1a571c-318a-4d02-aa65-8425f4afe47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1a571c-318a-4d02-aa65-8425f4afe47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:44:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6308166b-9bbc-4dc9-aae1-980f8381191e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:44:44 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Volume 59e47c83-b8ba-47e8-b72b-ff02801b8f57: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-59e47c83-b8ba-47e8-b72b-ff02801b8f57', 'volume_size': 1, 'source_volid': '20d4d864-bacf-4e82-85be-d80c7f073ce4', 'source_volstatus': 'available'} Nov 06 18:44:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:44 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Cloning volume 20d4d864-bacf-4e82-85be-d80c7f073ce4 to volume 59e47c83-b8ba-47e8-b72b-ff02801b8f57 Nov 06 18:44:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Creating offline snapshot fbb66abc-516b-452c-a263-a873d5670ccc of volume 20d4d864-bacf-4e82-85be-d80c7f073ce4 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:44:44 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf765a46-88ea-4f17-87e3-3dac5db4d9b4]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:44 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 Nov 06 18:44:44 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:44 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4" returned: 0 in 0.611s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:44 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc 1G Nov 06 18:44:44 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2d805ab4-1f64-4e5a-99d7-3ae4cd5bbe90 tempest-VolumesListAdminTestJSON-963000406 None] Acquiring lock "cinder-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2d805ab4-1f64-4e5a-99d7-3ae4cd5bbe90 tempest-VolumesListAdminTestJSON-963000406 None] Lock "cinder-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2d805ab4-1f64-4e5a-99d7-3ae4cd5bbe90 tempest-VolumesListAdminTestJSON-963000406 None] Acquiring lock "cinder-quobyte-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2d805ab4-1f64-4e5a-99d7-3ae4cd5bbe90 tempest-VolumesListAdminTestJSON-963000406 None] Lock "cinder-quobyte-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375" acquired by "delete_volume" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:45 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[0496d692-dba1-464e-af9d-91036a5f7ff5]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2d805ab4-1f64-4e5a-99d7-3ae4cd5bbe90 tempest-VolumesListAdminTestJSON-963000406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e77c2c38-8d65-4b65-9a87-61626fcca8dc tempest-VolumesListAdminTestJSON-77557207 None] Acquiring lock "cinder-c72aeebc-fe04-4ad3-872a-93ff96075986-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e77c2c38-8d65-4b65-9a87-61626fcca8dc tempest-VolumesListAdminTestJSON-77557207 None] Lock "cinder-c72aeebc-fe04-4ad3-872a-93ff96075986-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e77c2c38-8d65-4b65-9a87-61626fcca8dc tempest-VolumesListAdminTestJSON-77557207 None] Acquiring lock "cinder-quobyte-c72aeebc-fe04-4ad3-872a-93ff96075986" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e77c2c38-8d65-4b65-9a87-61626fcca8dc tempest-VolumesListAdminTestJSON-77557207 None] Lock "cinder-quobyte-c72aeebc-fe04-4ad3-872a-93ff96075986" acquired by "delete_volume" :: waited 0.052s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:45 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375 Nov 06 18:44:45 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:45 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57187b7-192b-4f61-a3d2-ae18b901d313]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e77c2c38-8d65-4b65-9a87-61626fcca8dc tempest-VolumesListAdminTestJSON-77557207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c72aeebc-fe04-4ad3-872a-93ff96075986 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:45 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc 1G" returned: 0 in 1.029s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:45 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc Nov 06 18:44:45 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:45 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c72aeebc-fe04-4ad3-872a-93ff96075986 Nov 06 18:44:45 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:46 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2d805ab4-1f64-4e5a-99d7-3ae4cd5bbe90 tempest-VolumesListAdminTestJSON-963000406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375" returned: 0 in 0.932s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2d805ab4-1f64-4e5a-99d7-3ae4cd5bbe90 tempest-VolumesListAdminTestJSON-963000406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:46 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375 Nov 06 18:44:46 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:46 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e77c2c38-8d65-4b65-9a87-61626fcca8dc tempest-VolumesListAdminTestJSON-77557207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c72aeebc-fe04-4ad3-872a-93ff96075986" returned: 0 in 0.790s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e77c2c38-8d65-4b65-9a87-61626fcca8dc tempest-VolumesListAdminTestJSON-77557207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c72aeebc-fe04-4ad3-872a-93ff96075986 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:46 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c72aeebc-fe04-4ad3-872a-93ff96075986 Nov 06 18:44:46 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:46 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc" returned: 0 in 0.701s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:46 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc is being set with open permissions: ugo+rw Nov 06 18:44:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:46 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc Nov 06 18:44:46 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:46 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2d805ab4-1f64-4e5a-99d7-3ae4cd5bbe90 tempest-VolumesListAdminTestJSON-963000406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375" returned: 0 in 0.778s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:46 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2d805ab4-1f64-4e5a-99d7-3ae4cd5bbe90 tempest-VolumesListAdminTestJSON-963000406 None] Lock "cinder-quobyte-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375" released by "delete_volume" :: held 1.822s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:46 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e77c2c38-8d65-4b65-9a87-61626fcca8dc tempest-VolumesListAdminTestJSON-77557207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c72aeebc-fe04-4ad3-872a-93ff96075986" returned: 0 in 0.575s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:46 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-2d805ab4-1f64-4e5a-99d7-3ae4cd5bbe90 tempest-VolumesListAdminTestJSON-963000406 None] Created reservations ['11ecc30d-82e7-498a-92c0-a05a2d21ee19', '061beb71-ea10-483c-88c7-7db519da937f', '9c2fa64b-c444-4af0-b3dd-41f03c5c706a', '041c892b-0438-4872-a2ec-6152a1ecbe99'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:44:46 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e77c2c38-8d65-4b65-9a87-61626fcca8dc tempest-VolumesListAdminTestJSON-77557207 None] Lock "cinder-quobyte-c72aeebc-fe04-4ad3-872a-93ff96075986" released by "delete_volume" :: held 1.454s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2d805ab4-1f64-4e5a-99d7-3ae4cd5bbe90 tempest-VolumesListAdminTestJSON-963000406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2d805ab4-1f64-4e5a-99d7-3ae4cd5bbe90 tempest-VolumesListAdminTestJSON-963000406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2d805ab4-1f64-4e5a-99d7-3ae4cd5bbe90 tempest-VolumesListAdminTestJSON-963000406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2d805ab4-1f64-4e5a-99d7-3ae4cd5bbe90 tempest-VolumesListAdminTestJSON-963000406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2d805ab4-1f64-4e5a-99d7-3ae4cd5bbe90 tempest-VolumesListAdminTestJSON-963000406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2d805ab4-1f64-4e5a-99d7-3ae4cd5bbe90 tempest-VolumesListAdminTestJSON-963000406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-e77c2c38-8d65-4b65-9a87-61626fcca8dc tempest-VolumesListAdminTestJSON-77557207 None] Created reservations ['72c9f10a-2f72-4cb4-8718-81ad6ab5aa22', '6dc41f98-b13c-4838-9f20-f93e9c692c32', 'b7c73c87-a1d8-4e17-a5aa-21500b6e44b6', 'b3f240b5-e322-4c21-8168-fd118fdced44'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:44:47 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc" returned: 0 in 0.728s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:47 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:44:47 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:47 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.info Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e77c2c38-8d65-4b65-9a87-61626fcca8dc tempest-VolumesListAdminTestJSON-77557207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e77c2c38-8d65-4b65-9a87-61626fcca8dc tempest-VolumesListAdminTestJSON-77557207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e77c2c38-8d65-4b65-9a87-61626fcca8dc tempest-VolumesListAdminTestJSON-77557207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:47 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e77c2c38-8d65-4b65-9a87-61626fcca8dc tempest-VolumesListAdminTestJSON-77557207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e77c2c38-8d65-4b65-9a87-61626fcca8dc tempest-VolumesListAdminTestJSON-77557207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e77c2c38-8d65-4b65-9a87-61626fcca8dc tempest-VolumesListAdminTestJSON-77557207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:47 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:44:47 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:47 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.info" returned: 0 in 0.462s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:47 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.info is being set with open permissions: ugo+rw Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:47 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2d805ab4-1f64-4e5a-99d7-3ae4cd5bbe90 tempest-VolumesListAdminTestJSON-963000406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.637s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-2d805ab4-1f64-4e5a-99d7-3ae4cd5bbe90 tempest-VolumesListAdminTestJSON-963000406 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:44:47 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-2d805ab4-1f64-4e5a-99d7-3ae4cd5bbe90 tempest-VolumesListAdminTestJSON-963000406 None] Deleted volume successfully. Nov 06 18:44:47 devstack sudo[101112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.info Nov 06 18:44:47 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-31a606b3-ce93-4cd4-9170-cb7c3e4c452c tempest-VolumesListAdminTestJSON-77557207 None] Acquiring lock "cinder-78894c65-75a9-406f-88a8-6da3d6531ddc-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2d805ab4-1f64-4e5a-99d7-3ae4cd5bbe90 tempest-VolumesListAdminTestJSON-963000406 None] Lock "cinder-0e23cdb0-2f09-4d6b-be0f-a95b5b7ff375-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:47 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-31a606b3-ce93-4cd4-9170-cb7c3e4c452c tempest-VolumesListAdminTestJSON-77557207 None] Lock "cinder-78894c65-75a9-406f-88a8-6da3d6531ddc-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:48 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-31a606b3-ce93-4cd4-9170-cb7c3e4c452c tempest-VolumesListAdminTestJSON-77557207 None] Acquiring lock "cinder-quobyte-78894c65-75a9-406f-88a8-6da3d6531ddc" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e77c2c38-8d65-4b65-9a87-61626fcca8dc tempest-VolumesListAdminTestJSON-77557207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.714s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:48 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-e77c2c38-8d65-4b65-9a87-61626fcca8dc tempest-VolumesListAdminTestJSON-77557207 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:44:48 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-e77c2c38-8d65-4b65-9a87-61626fcca8dc tempest-VolumesListAdminTestJSON-77557207 None] Deleted volume successfully. Nov 06 18:44:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-31a606b3-ce93-4cd4-9170-cb7c3e4c452c tempest-VolumesListAdminTestJSON-77557207 None] Lock "cinder-quobyte-78894c65-75a9-406f-88a8-6da3d6531ddc" acquired by "delete_volume" :: waited 0.079s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e77c2c38-8d65-4b65-9a87-61626fcca8dc tempest-VolumesListAdminTestJSON-77557207 None] Lock "cinder-c72aeebc-fe04-4ad3-872a-93ff96075986-delete_volume" released by "delete_volume" :: held 2.867s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:48 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f0241a-8787-4d53-b86d-74562c56d093]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-31a606b3-ce93-4cd4-9170-cb7c3e4c452c tempest-VolumesListAdminTestJSON-77557207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-78894c65-75a9-406f-88a8-6da3d6531ddc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:48 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.info" returned: 0 in 0.562s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Acquiring lock "cinder-quobyte-59e47c83-b8ba-47e8-b72b-ff02801b8f57" by "_copy_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Lock "cinder-quobyte-59e47c83-b8ba-47e8-b72b-ff02801b8f57" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] snapshot: fbb66abc-516b-452c-a263-a873d5670ccc, volume: 59e47c83-b8ba-47e8-b72b-ff02801b8f57, {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 18:44:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:48 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-78894c65-75a9-406f-88a8-6da3d6531ddc Nov 06 18:44:48 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:48 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[33af5aee-5697-49df-a792-7475fefca77f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:48 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc Nov 06 18:44:48 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:48 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-31a606b3-ce93-4cd4-9170-cb7c3e4c452c tempest-VolumesListAdminTestJSON-77557207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-78894c65-75a9-406f-88a8-6da3d6531ddc" returned: 0 in 0.671s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-31a606b3-ce93-4cd4-9170-cb7c3e4c452c tempest-VolumesListAdminTestJSON-77557207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-78894c65-75a9-406f-88a8-6da3d6531ddc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:48 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-78894c65-75a9-406f-88a8-6da3d6531ddc Nov 06 18:44:48 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:49 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc" returned: 0 in 0.669s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20d4d864-bacf-4e82-85be-d80c7f073ce4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[3043ec63-ad1b-4112-8c7e-ac4877d89888]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:49 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-31a606b3-ce93-4cd4-9170-cb7c3e4c452c tempest-VolumesListAdminTestJSON-77557207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-78894c65-75a9-406f-88a8-6da3d6531ddc" returned: 0 in 0.343s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-31a606b3-ce93-4cd4-9170-cb7c3e4c452c tempest-VolumesListAdminTestJSON-77557207 None] Lock "cinder-quobyte-78894c65-75a9-406f-88a8-6da3d6531ddc" released by "delete_volume" :: held 1.121s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:49 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 Nov 06 18:44:49 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-31a606b3-ce93-4cd4-9170-cb7c3e4c452c tempest-VolumesListAdminTestJSON-77557207 None] Created reservations ['a3e255b3-7101-4c66-a404-e3e7a6b049dc', 'abf35c73-8327-4fa7-9c5f-3ccd5933a753', '86779392-7cad-4032-b131-f2f6fa2d7c63', '4b52cbae-0396-4d1e-aa37-f6728b20f929'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-31a606b3-ce93-4cd4-9170-cb7c3e4c452c tempest-VolumesListAdminTestJSON-77557207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-31a606b3-ce93-4cd4-9170-cb7c3e4c452c tempest-VolumesListAdminTestJSON-77557207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-31a606b3-ce93-4cd4-9170-cb7c3e4c452c tempest-VolumesListAdminTestJSON-77557207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-31a606b3-ce93-4cd4-9170-cb7c3e4c452c tempest-VolumesListAdminTestJSON-77557207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-31a606b3-ce93-4cd4-9170-cb7c3e4c452c tempest-VolumesListAdminTestJSON-77557207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-31a606b3-ce93-4cd4-9170-cb7c3e4c452c tempest-VolumesListAdminTestJSON-77557207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:49 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:44:49 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:49 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4" returned: 0 in 0.558s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Creating direct copy from snapshot {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG cinder.utils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Path /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59e47c83-b8ba-47e8-b72b-ff02801b8f57 not found in is_blk_device check {{(pid=86794) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59e47c83-b8ba-47e8-b72b-ff02801b8f57 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:49 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59e47c83-b8ba-47e8-b72b-ff02801b8f57 Nov 06 18:44:49 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:49 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-31a606b3-ce93-4cd4-9170-cb7c3e4c452c tempest-VolumesListAdminTestJSON-77557207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.350s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-31a606b3-ce93-4cd4-9170-cb7c3e4c452c tempest-VolumesListAdminTestJSON-77557207 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:44:49 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-31a606b3-ce93-4cd4-9170-cb7c3e4c452c tempest-VolumesListAdminTestJSON-77557207 None] Deleted volume successfully. Nov 06 18:44:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-31a606b3-ce93-4cd4-9170-cb7c3e4c452c tempest-VolumesListAdminTestJSON-77557207 None] Lock "cinder-78894c65-75a9-406f-88a8-6da3d6531ddc-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e3c561cb-a80a-4245-a394-5fe4e4be3679 tempest-VolumesListAdminTestJSON-77557207 None] Acquiring lock "cinder-1eb9adc6-9884-4ec6-86fc-d855f3495505-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e3c561cb-a80a-4245-a394-5fe4e4be3679 tempest-VolumesListAdminTestJSON-77557207 None] Lock "cinder-1eb9adc6-9884-4ec6-86fc-d855f3495505-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e3c561cb-a80a-4245-a394-5fe4e4be3679 tempest-VolumesListAdminTestJSON-77557207 None] Acquiring lock "cinder-quobyte-1eb9adc6-9884-4ec6-86fc-d855f3495505" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e3c561cb-a80a-4245-a394-5fe4e4be3679 tempest-VolumesListAdminTestJSON-77557207 None] Lock "cinder-quobyte-1eb9adc6-9884-4ec6-86fc-d855f3495505" acquired by "delete_volume" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:50 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[b701cfd8-5bb9-4f4d-baf5-48785d9ae4ba]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e3c561cb-a80a-4245-a394-5fe4e4be3679 tempest-VolumesListAdminTestJSON-77557207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1eb9adc6-9884-4ec6-86fc-d855f3495505 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:51 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1eb9adc6-9884-4ec6-86fc-d855f3495505 Nov 06 18:44:51 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:51 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e3c561cb-a80a-4245-a394-5fe4e4be3679 tempest-VolumesListAdminTestJSON-77557207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1eb9adc6-9884-4ec6-86fc-d855f3495505" returned: 0 in 0.978s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e3c561cb-a80a-4245-a394-5fe4e4be3679 tempest-VolumesListAdminTestJSON-77557207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1eb9adc6-9884-4ec6-86fc-d855f3495505 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:51 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1eb9adc6-9884-4ec6-86fc-d855f3495505 Nov 06 18:44:51 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:52 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e3c561cb-a80a-4245-a394-5fe4e4be3679 tempest-VolumesListAdminTestJSON-77557207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1eb9adc6-9884-4ec6-86fc-d855f3495505" returned: 0 in 0.427s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e3c561cb-a80a-4245-a394-5fe4e4be3679 tempest-VolumesListAdminTestJSON-77557207 None] Lock "cinder-quobyte-1eb9adc6-9884-4ec6-86fc-d855f3495505" released by "delete_volume" :: held 1.549s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:52 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-e3c561cb-a80a-4245-a394-5fe4e4be3679 tempest-VolumesListAdminTestJSON-77557207 None] Created reservations ['870b05a2-6f42-49b6-9373-3df98c686478', '109249ed-df63-4866-9b05-6c1ba6001a13', 'a316687f-665d-480f-8eb1-625353d55eaf', 'dc80c95c-adee-4886-bcea-32d17da29758'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:44:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e3c561cb-a80a-4245-a394-5fe4e4be3679 tempest-VolumesListAdminTestJSON-77557207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:44:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e3c561cb-a80a-4245-a394-5fe4e4be3679 tempest-VolumesListAdminTestJSON-77557207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:44:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e3c561cb-a80a-4245-a394-5fe4e4be3679 tempest-VolumesListAdminTestJSON-77557207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:44:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e3c561cb-a80a-4245-a394-5fe4e4be3679 tempest-VolumesListAdminTestJSON-77557207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:44:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e3c561cb-a80a-4245-a394-5fe4e4be3679 tempest-VolumesListAdminTestJSON-77557207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:44:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e3c561cb-a80a-4245-a394-5fe4e4be3679 tempest-VolumesListAdminTestJSON-77557207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:52 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:44:52 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:53 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e3c561cb-a80a-4245-a394-5fe4e4be3679 tempest-VolumesListAdminTestJSON-77557207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.613s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:53 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-e3c561cb-a80a-4245-a394-5fe4e4be3679 tempest-VolumesListAdminTestJSON-77557207 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:44:53 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-e3c561cb-a80a-4245-a394-5fe4e4be3679 tempest-VolumesListAdminTestJSON-77557207 None] Deleted volume successfully. Nov 06 18:44:53 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e3c561cb-a80a-4245-a394-5fe4e4be3679 tempest-VolumesListAdminTestJSON-77557207 None] Lock "cinder-1eb9adc6-9884-4ec6-86fc-d855f3495505-delete_volume" released by "delete_volume" :: held 2.762s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:58 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59e47c83-b8ba-47e8-b72b-ff02801b8f57" returned: 0 in 8.917s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:58 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4, size 1024.00 MB, duration 8.92 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59e47c83-b8ba-47e8-b72b-ff02801b8f57 {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:44:58 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Converted 1024.00 MB image at 114.82 MB/s Nov 06 18:44:58 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59e47c83-b8ba-47e8-b72b-ff02801b8f57 is being set with open permissions: ugo+rw Nov 06 18:44:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59e47c83-b8ba-47e8-b72b-ff02801b8f57 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:58 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59e47c83-b8ba-47e8-b72b-ff02801b8f57 Nov 06 18:44:58 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:58 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59e47c83-b8ba-47e8-b72b-ff02801b8f57" returned: 0 in 0.265s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:58 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Lock "cinder-quobyte-59e47c83-b8ba-47e8-b72b-ff02801b8f57" released by "_copy_volume_from_snapshot" :: held 10.554s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:44:58 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:UPDATE=150,cinder:SELECT=119,cinder:INSERT=37,cinder:DELETE=13 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:44:58 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Acquiring lock "cinder-quobyte-fbb66abc-516b-452c-a263-a873d5670ccc" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:44:58 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Lock "cinder-quobyte-fbb66abc-516b-452c-a263-a873d5670ccc" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:44:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Deleting offline snapshot fbb66abc-516b-452c-a263-a873d5670ccc of volume 20d4d864-bacf-4e82-85be-d80c7f073ce4 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:44:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] snapshot_file for this snap is: volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:44:59 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[722ef46e-48d6-4e4f-8730-74fa5f398241]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:59 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc Nov 06 18:44:59 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:44:59 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Nov 06 18:44:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc" returned: 0 in 0.397s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:44:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20d4d864-bacf-4e82-85be-d80c7f073ce4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:44:59 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ff0385-0a16-47cd-98b9-84303cc20acc]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:44:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:44:59 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 Nov 06 18:44:59 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:00 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4" returned: 0 in 0.618s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:00 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc Nov 06 18:45:00 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:00 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc" returned: 0 in 0.352s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:00 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc Nov 06 18:45:00 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:00 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4.fbb66abc-516b-452c-a263-a873d5670ccc" returned: 0 in 0.290s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:00 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Lock "cinder-quobyte-fbb66abc-516b-452c-a263-a873d5670ccc" released by "_delete_snapshot" :: held 1.801s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:00 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=107,cinder:UPDATE=132,cinder:DELETE=12,cinder:INSERT=33 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:45:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.794s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6308166b-9bbc-4dc9-aae1-980f8381191e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59e47c83-b8ba-47e8-b72b-ff02801b8f57', 'volume_size': 1, 'source_volid': '20d4d864-bacf-4e82-85be-d80c7f073ce4', 'source_volstatus': 'available'}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4301173-a5d1-43b8-a1cb-6c382f78d816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:00 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Volume volume-59e47c83-b8ba-47e8-b72b-ff02801b8f57 (59e47c83-b8ba-47e8-b72b-ff02801b8f57): created successfully Nov 06 18:45:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4301173-a5d1-43b8-a1cb-6c382f78d816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Flow 'volume_create_manager' (1b35f37f-8f34-47ca-90f5-a487e40194e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:00 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-4931b38a-7c08-4a93-b469-48a0f2bd656e tempest-VolumesGetTest-1608161745 None] Created volume successfully. Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Flow 'volume_create_manager' (510972d6-fdb9-42c5-a704-de87104de675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88f5ff6-de74-4eaf-ab4a-3a90a983bd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88f5ff6-de74-4eaf-ab4a-3a90a983bd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-827879935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3917bbf3-958a-4622-95b8-7501d4e1b55b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f49c7301e36404e8f958b5f02f0ff58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:02Z,use_quota=True,user_id='fcc7e8b0235c4deab37876f5b2ca5f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b025da-8bae-4823-b51d-8c17939b1210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b025da-8bae-4823-b51d-8c17939b1210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f26a5df-af33-4e52-abc4-5ce956195a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f26a5df-af33-4e52-abc4-5ce956195a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3917bbf3-958a-4622-95b8-7501d4e1b55b', 'volume_name': 'volume-3917bbf3-958a-4622-95b8-7501d4e1b55b', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d673118-585c-4b50-aa2a-256d350280ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d673118-585c-4b50-aa2a-256d350280ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (350f3690-6681-412a-9165-8a5ada853c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:01 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Volume 3917bbf3-958a-4622-95b8-7501d4e1b55b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3917bbf3-958a-4622-95b8-7501d4e1b55b', 'volume_size': 1} Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-827879935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3917bbf3-958a-4622-95b8-7501d4e1b55b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f49c7301e36404e8f958b5f02f0ff58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:02Z,use_quota=True,user_id='fcc7e8b0235c4deab37876f5b2ca5f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Creating volume 3917bbf3-958a-4622-95b8-7501d4e1b55b {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:45:01 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:45:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:01 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b 1073741824 Nov 06 18:45:01 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:02 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b 1073741824" returned: 0 in 0.607s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:02 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b Nov 06 18:45:02 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:02 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b" returned: 0 in 0.379s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:02 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:45:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (350f3690-6681-412a-9165-8a5ada853c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3917bbf3-958a-4622-95b8-7501d4e1b55b', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c567a1-ab19-4ada-8ce1-6ff908fcd291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:03 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Volume volume-3917bbf3-958a-4622-95b8-7501d4e1b55b (3917bbf3-958a-4622-95b8-7501d4e1b55b): created successfully Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c567a1-ab19-4ada-8ce1-6ff908fcd291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Flow 'volume_create_manager' (510972d6-fdb9-42c5-a704-de87104de675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:03 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-adcbd5b4-5230-479f-87e8-a234944cdb4e tempest-VolumesCloneTest-1631173854 None] Created volume successfully. Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Flow 'volume_create_manager' (ae678236-1a3e-421f-95f2-c3dcad882871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30082621-60d7-4a66-bb69-511ed0fc8c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30082621-60d7-4a66-bb69-511ed0fc8c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-353710688',display_name='tempest-VolumesGetTest-Volume-1008725640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0dac67e-17f4-416a-87cc-11a77f7e7b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034d99ffb5614dafa26e0f668401247b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:03Z,use_quota=True,user_id='74ddfdab2949404d8297e23626514f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c940eaf1-c076-4930-92f6-e32db298b6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c940eaf1-c076-4930-92f6-e32db298b6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2102c070-6bbe-4643-9b9f-44f6a80bb869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2102c070-6bbe-4643-9b9f-44f6a80bb869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0dac67e-17f4-416a-87cc-11a77f7e7b6f', 'volume_name': 'volume-f0dac67e-17f4-416a-87cc-11a77f7e7b6f', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b24b0a-c988-43db-b8a9-6a41eb96d2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b24b0a-c988-43db-b8a9-6a41eb96d2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd47f599-0a9d-43f2-bfe9-45e9b2628727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:03 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Volume f0dac67e-17f4-416a-87cc-11a77f7e7b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0dac67e-17f4-416a-87cc-11a77f7e7b6f', 'volume_size': 1} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-353710688',display_name='tempest-VolumesGetTest-Volume-1008725640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0dac67e-17f4-416a-87cc-11a77f7e7b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034d99ffb5614dafa26e0f668401247b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:03Z,use_quota=True,user_id='74ddfdab2949404d8297e23626514f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Creating volume f0dac67e-17f4-416a-87cc-11a77f7e7b6f {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:45:03 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f0dac67e-17f4-416a-87cc-11a77f7e7b6f 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:03 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f0dac67e-17f4-416a-87cc-11a77f7e7b6f 1073741824 Nov 06 18:45:03 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:03 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f0dac67e-17f4-416a-87cc-11a77f7e7b6f 1073741824" returned: 0 in 0.507s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f0dac67e-17f4-416a-87cc-11a77f7e7b6f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:03 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f0dac67e-17f4-416a-87cc-11a77f7e7b6f Nov 06 18:45:03 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:04 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f0dac67e-17f4-416a-87cc-11a77f7e7b6f" returned: 0 in 0.340s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd47f599-0a9d-43f2-bfe9-45e9b2628727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0dac67e-17f4-416a-87cc-11a77f7e7b6f', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8090a8-bbea-4870-868e-41e251150eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:04 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Volume volume-f0dac67e-17f4-416a-87cc-11a77f7e7b6f (f0dac67e-17f4-416a-87cc-11a77f7e7b6f): created successfully Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8090a8-bbea-4870-868e-41e251150eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Flow 'volume_create_manager' (ae678236-1a3e-421f-95f2-c3dcad882871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:04 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-1416119b-30c2-4372-816c-31ced8e8830a tempest-VolumesGetTest-1608161745 None] Created volume successfully. Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Flow 'volume_create_manager' (f2188e35-be94-4eca-b2b0-ed9692b5c6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f571da8b-3c26-4afe-a56b-a46b3289adf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f571da8b-3c26-4afe-a56b-a46b3289adf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2049377394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2da4fab-02b1-48c3-9965-cc772f8ff31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f49c7301e36404e8f958b5f02f0ff58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=3917bbf3-958a-4622-95b8-7501d4e1b55b,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:04Z,use_quota=True,user_id='fcc7e8b0235c4deab37876f5b2ca5f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca41db1-1086-4171-809f-02115cf48287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca41db1-1086-4171-809f-02115cf48287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d64bff5-4a2d-4f4f-bc77-363df0897668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d64bff5-4a2d-4f4f-bc77-363df0897668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e2da4fab-02b1-48c3-9965-cc772f8ff31c', 'volume_name': 'volume-e2da4fab-02b1-48c3-9965-cc772f8ff31c', 'volume_size': 2, 'source_volid': '3917bbf3-958a-4622-95b8-7501d4e1b55b', 'source_volstatus': 'available'}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cea5458-6a4c-4213-ac82-6268bcb76593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cea5458-6a4c-4213-ac82-6268bcb76593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9488901-d7ac-46f8-8053-594b141716a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:04 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Volume e2da4fab-02b1-48c3-9965-cc772f8ff31c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e2da4fab-02b1-48c3-9965-cc772f8ff31c', 'volume_size': 2, 'source_volid': '3917bbf3-958a-4622-95b8-7501d4e1b55b', 'source_volstatus': 'available'} Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:04 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Cloning volume 3917bbf3-958a-4622-95b8-7501d4e1b55b to volume e2da4fab-02b1-48c3-9965-cc772f8ff31c Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Creating offline snapshot 0ed018f8-e4f2-4fc2-add6-3d446754d0cf of volume 3917bbf3-958a-4622-95b8-7501d4e1b55b {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b88c97d-4f63-4145-ab06-b6382e0c42d4]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:04 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b Nov 06 18:45:04 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:05 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b" returned: 0 in 0.429s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:05 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf 1G Nov 06 18:45:05 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:05 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9acab241-4dfd-4fe8-84ab-5d83aead1c1f tempest-VolumesGetTest-1608161745 None] Acquiring lock "cinder-f0dac67e-17f4-416a-87cc-11a77f7e7b6f-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:05 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9acab241-4dfd-4fe8-84ab-5d83aead1c1f tempest-VolumesGetTest-1608161745 None] Lock "cinder-f0dac67e-17f4-416a-87cc-11a77f7e7b6f-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:05 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9acab241-4dfd-4fe8-84ab-5d83aead1c1f tempest-VolumesGetTest-1608161745 None] Acquiring lock "cinder-quobyte-f0dac67e-17f4-416a-87cc-11a77f7e7b6f" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:05 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9acab241-4dfd-4fe8-84ab-5d83aead1c1f tempest-VolumesGetTest-1608161745 None] Lock "cinder-quobyte-f0dac67e-17f4-416a-87cc-11a77f7e7b6f" acquired by "delete_volume" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:05 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c418f8b-83d8-45d0-8ff6-697ba70ac62f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9acab241-4dfd-4fe8-84ab-5d83aead1c1f tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f0dac67e-17f4-416a-87cc-11a77f7e7b6f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:05 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f0dac67e-17f4-416a-87cc-11a77f7e7b6f Nov 06 18:45:05 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:05 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf 1G" returned: 0 in 0.590s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3917bbf3-958a-4622-95b8-7501d4e1b55b -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:05 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3917bbf3-958a-4622-95b8-7501d4e1b55b -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf Nov 06 18:45:05 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:05 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9acab241-4dfd-4fe8-84ab-5d83aead1c1f tempest-VolumesGetTest-1608161745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f0dac67e-17f4-416a-87cc-11a77f7e7b6f" returned: 0 in 0.431s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9acab241-4dfd-4fe8-84ab-5d83aead1c1f tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f0dac67e-17f4-416a-87cc-11a77f7e7b6f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:06 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f0dac67e-17f4-416a-87cc-11a77f7e7b6f Nov 06 18:45:06 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:06 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3917bbf3-958a-4622-95b8-7501d4e1b55b -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf" returned: 0 in 0.342s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:06 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf is being set with open permissions: ugo+rw Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:06 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf Nov 06 18:45:06 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:06 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9acab241-4dfd-4fe8-84ab-5d83aead1c1f tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f0dac67e-17f4-416a-87cc-11a77f7e7b6f" returned: 0 in 0.243s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9acab241-4dfd-4fe8-84ab-5d83aead1c1f tempest-VolumesGetTest-1608161745 None] Lock "cinder-quobyte-f0dac67e-17f4-416a-87cc-11a77f7e7b6f" released by "delete_volume" :: held 0.729s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-9acab241-4dfd-4fe8-84ab-5d83aead1c1f tempest-VolumesGetTest-1608161745 None] Created reservations ['235439ca-3209-4ad8-bf37-e06429df657a', '489ae371-ba54-4429-abba-f8fa95a659a6', '1d457b7e-6c4e-4581-af67-cb20ab853348', 'fb80c8e4-80d5-45d0-ad17-6877d2ae804c'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:45:06 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf" returned: 0 in 0.267s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:06 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.info Nov 06 18:45:06 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9acab241-4dfd-4fe8-84ab-5d83aead1c1f tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9acab241-4dfd-4fe8-84ab-5d83aead1c1f tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9acab241-4dfd-4fe8-84ab-5d83aead1c1f tempest-VolumesGetTest-1608161745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9acab241-4dfd-4fe8-84ab-5d83aead1c1f tempest-VolumesGetTest-1608161745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9acab241-4dfd-4fe8-84ab-5d83aead1c1f tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9acab241-4dfd-4fe8-84ab-5d83aead1c1f tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:06 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:45:06 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:06 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fbfaf2d9-0cd3-414f-8aa0-258ac6b0516e tempest-VolumesGetTest-1608161745 None] Acquiring lock "cinder-59e47c83-b8ba-47e8-b72b-ff02801b8f57-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.info" returned: 0 in 0.402s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:06 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.info is being set with open permissions: ugo+rw Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:06 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.info Nov 06 18:45:06 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fbfaf2d9-0cd3-414f-8aa0-258ac6b0516e tempest-VolumesGetTest-1608161745 None] Lock "cinder-59e47c83-b8ba-47e8-b72b-ff02801b8f57-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:06 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fbfaf2d9-0cd3-414f-8aa0-258ac6b0516e tempest-VolumesGetTest-1608161745 None] Acquiring lock "cinder-quobyte-59e47c83-b8ba-47e8-b72b-ff02801b8f57" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9acab241-4dfd-4fe8-84ab-5d83aead1c1f tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.455s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-9acab241-4dfd-4fe8-84ab-5d83aead1c1f tempest-VolumesGetTest-1608161745 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:45:06 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-9acab241-4dfd-4fe8-84ab-5d83aead1c1f tempest-VolumesGetTest-1608161745 None] Deleted volume successfully. Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fbfaf2d9-0cd3-414f-8aa0-258ac6b0516e tempest-VolumesGetTest-1608161745 None] Lock "cinder-quobyte-59e47c83-b8ba-47e8-b72b-ff02801b8f57" acquired by "delete_volume" :: waited 0.039s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9acab241-4dfd-4fe8-84ab-5d83aead1c1f tempest-VolumesGetTest-1608161745 None] Lock "cinder-f0dac67e-17f4-416a-87cc-11a77f7e7b6f-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[c839eeb4-0e44-4c27-a60b-db9b20500789]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fbfaf2d9-0cd3-414f-8aa0-258ac6b0516e tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59e47c83-b8ba-47e8-b72b-ff02801b8f57 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:07 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.info" returned: 0 in 0.274s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Acquiring lock "cinder-quobyte-e2da4fab-02b1-48c3-9965-cc772f8ff31c" by "_copy_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Lock "cinder-quobyte-e2da4fab-02b1-48c3-9965-cc772f8ff31c" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] snapshot: 0ed018f8-e4f2-4fc2-add6-3d446754d0cf, volume: e2da4fab-02b1-48c3-9965-cc772f8ff31c, {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 18:45:07 devstack sudo[101288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59e47c83-b8ba-47e8-b72b-ff02801b8f57 Nov 06 18:45:07 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac0906e-9e71-4919-a499-8ef9ddb505c6]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:07 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf Nov 06 18:45:07 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:07 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fbfaf2d9-0cd3-414f-8aa0-258ac6b0516e tempest-VolumesGetTest-1608161745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59e47c83-b8ba-47e8-b72b-ff02801b8f57" returned: 0 in 0.466s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fbfaf2d9-0cd3-414f-8aa0-258ac6b0516e tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59e47c83-b8ba-47e8-b72b-ff02801b8f57 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:07 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59e47c83-b8ba-47e8-b72b-ff02801b8f57 Nov 06 18:45:07 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:07 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf" returned: 0 in 0.463s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3917bbf3-958a-4622-95b8-7501d4e1b55b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[094b5a29-2ef9-4f5d-b2a6-d7d1efdca8de]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:07 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fbfaf2d9-0cd3-414f-8aa0-258ac6b0516e tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-59e47c83-b8ba-47e8-b72b-ff02801b8f57" returned: 0 in 0.363s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:07 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b Nov 06 18:45:07 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fbfaf2d9-0cd3-414f-8aa0-258ac6b0516e tempest-VolumesGetTest-1608161745 None] Lock "cinder-quobyte-59e47c83-b8ba-47e8-b72b-ff02801b8f57" released by "delete_volume" :: held 0.892s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-fbfaf2d9-0cd3-414f-8aa0-258ac6b0516e tempest-VolumesGetTest-1608161745 None] Created reservations ['49917b11-034f-4f73-8aca-bed3184072dd', '37150283-6ca1-477b-b0d3-dca0efbc7591', 'c26dedf3-9be6-4b0c-bdc7-a75a16caddeb', '781996da-b1fe-4c00-bbfe-ab1527ae6525'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fbfaf2d9-0cd3-414f-8aa0-258ac6b0516e tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fbfaf2d9-0cd3-414f-8aa0-258ac6b0516e tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fbfaf2d9-0cd3-414f-8aa0-258ac6b0516e tempest-VolumesGetTest-1608161745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fbfaf2d9-0cd3-414f-8aa0-258ac6b0516e tempest-VolumesGetTest-1608161745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fbfaf2d9-0cd3-414f-8aa0-258ac6b0516e tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fbfaf2d9-0cd3-414f-8aa0-258ac6b0516e tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:08 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:45:08 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:08 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b" returned: 0 in 0.583s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 18:45:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Creating direct copy from snapshot {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 18:45:08 devstack cinder-volume[86794]: DEBUG cinder.utils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Path /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2da4fab-02b1-48c3-9965-cc772f8ff31c not found in is_blk_device check {{(pid=86794) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 18:45:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2da4fab-02b1-48c3-9965-cc772f8ff31c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:08 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2da4fab-02b1-48c3-9965-cc772f8ff31c Nov 06 18:45:08 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:08 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fbfaf2d9-0cd3-414f-8aa0-258ac6b0516e tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.348s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:08 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-fbfaf2d9-0cd3-414f-8aa0-258ac6b0516e tempest-VolumesGetTest-1608161745 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:45:08 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-fbfaf2d9-0cd3-414f-8aa0-258ac6b0516e tempest-VolumesGetTest-1608161745 None] Deleted volume successfully. Nov 06 18:45:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fbfaf2d9-0cd3-414f-8aa0-258ac6b0516e tempest-VolumesGetTest-1608161745 None] Lock "cinder-59e47c83-b8ba-47e8-b72b-ff02801b8f57-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-c87b9177-b964-4f5f-9a75-6de0ae790562 req-5e9af3d9-ec15-4250-ba79-39ad2cb08724 tempest-TestInstancesWithCinderVolumes-1982719473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-96891736-3e41-4962-8cc8-f0547bb442f0 tempest-VolumesGetTest-1608161745 None] Acquiring lock "cinder-20d4d864-bacf-4e82-85be-d80c7f073ce4-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-96891736-3e41-4962-8cc8-f0547bb442f0 tempest-VolumesGetTest-1608161745 None] Lock "cinder-20d4d864-bacf-4e82-85be-d80c7f073ce4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-96891736-3e41-4962-8cc8-f0547bb442f0 tempest-VolumesGetTest-1608161745 None] Acquiring lock "cinder-quobyte-20d4d864-bacf-4e82-85be-d80c7f073ce4" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-96891736-3e41-4962-8cc8-f0547bb442f0 tempest-VolumesGetTest-1608161745 None] Lock "cinder-quobyte-20d4d864-bacf-4e82-85be-d80c7f073ce4" acquired by "delete_volume" :: waited 0.034s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:09 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[b218ceb1-a758-4e74-996f-a733fe112651]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-96891736-3e41-4962-8cc8-f0547bb442f0 tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:09 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 Nov 06 18:45:09 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:10 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-96891736-3e41-4962-8cc8-f0547bb442f0 tempest-VolumesGetTest-1608161745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4" returned: 0 in 0.782s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-96891736-3e41-4962-8cc8-f0547bb442f0 tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:10 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4 Nov 06 18:45:10 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:10 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-96891736-3e41-4962-8cc8-f0547bb442f0 tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20d4d864-bacf-4e82-85be-d80c7f073ce4" returned: 0 in 0.563s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-96891736-3e41-4962-8cc8-f0547bb442f0 tempest-VolumesGetTest-1608161745 None] Lock "cinder-quobyte-20d4d864-bacf-4e82-85be-d80c7f073ce4" released by "delete_volume" :: held 1.499s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:11 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-96891736-3e41-4962-8cc8-f0547bb442f0 tempest-VolumesGetTest-1608161745 None] Created reservations ['219d2f1a-d50b-4def-ac08-3a249f4d6d30', 'c2d61878-a494-417b-b961-22e6ca1890e7', '7a7ee5e7-56ec-4a8c-9fc4-46e4b33221bb', '64052503-90cd-4d8a-90d9-621a342176e4'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:45:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-96891736-3e41-4962-8cc8-f0547bb442f0 tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-96891736-3e41-4962-8cc8-f0547bb442f0 tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-96891736-3e41-4962-8cc8-f0547bb442f0 tempest-VolumesGetTest-1608161745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-96891736-3e41-4962-8cc8-f0547bb442f0 tempest-VolumesGetTest-1608161745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-96891736-3e41-4962-8cc8-f0547bb442f0 tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-96891736-3e41-4962-8cc8-f0547bb442f0 tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:11 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:45:11 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:11 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-96891736-3e41-4962-8cc8-f0547bb442f0 tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.503s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:11 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-96891736-3e41-4962-8cc8-f0547bb442f0 tempest-VolumesGetTest-1608161745 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:45:11 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-96891736-3e41-4962-8cc8-f0547bb442f0 tempest-VolumesGetTest-1608161745 None] Deleted volume successfully. Nov 06 18:45:11 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-96891736-3e41-4962-8cc8-f0547bb442f0 tempest-VolumesGetTest-1608161745 None] Lock "cinder-20d4d864-bacf-4e82-85be-d80c7f073ce4-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:13 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:45:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Flow 'volume_create_manager' (ad98f9bb-d12c-4de4-a827-a859086d32d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1849bf9d-da69-496b-81ac-f08b8bef4447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1849bf9d-da69-496b-81ac-f08b8bef4447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-728575814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0c2d75-7d85-4bdc-b67f-4e071459bd36,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='034d99ffb5614dafa26e0f668401247b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:14Z,use_quota=True,user_id='74ddfdab2949404d8297e23626514f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1082182-3e95-4603-b224-e8869c6fae72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1082182-3e95-4603-b224-e8869c6fae72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fcb2bb4-3742-4435-9166-dda480f1dd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:13 devstack cinder-volume[86794]: DEBUG cinder.image.glance [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Creating Keystone auth plugin from conf {{(pid=86794) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 18:45:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fcb2bb4-3742-4435-9166-dda480f1dd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2f0c2d75-7d85-4bdc-b67f-4e071459bd36', 'volume_name': 'volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36', 'volume_size': 1, 'image_id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d57c6da8e464b1a80cefabe6e3cfecd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'created_at': datetime.datetime(2026, 11, 6, 17, 27, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 27, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166bd00a-da0e-4eef-be99-2e4231276f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166bd00a-da0e-4eef-be99-2e4231276f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb93753-cb7d-4463-9caf-8a8b61ef287f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:14 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Volume 2f0c2d75-7d85-4bdc-b67f-4e071459bd36: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36', 'volume_size': 1, 'image_id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d57c6da8e464b1a80cefabe6e3cfecd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'created_at': datetime.datetime(2026, 11, 6, 17, 27, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 27, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 18:45:14 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Trying to clone 2f0c2d75-7d85-4bdc-b67f-4e071459bd36 from image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}]). {{(pid=86794) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 18:45:15 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ssos906tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 18:45:15 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Image download 20.69 MB at 20.69 MB/s Nov 06 18:45:15 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[627c11b0-f0e0-4df7-b4d8-f36850775a7d]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ssos906tdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:15 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ssos906tdevstack@QuobyteHD Nov 06 18:45:15 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:15 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ssos906tdevstack@QuobyteHD" returned: 0 in 0.581s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:15 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Temporary image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 is fetched for user 74ddfdab2949404d8297e23626514f70. {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 18:45:15 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[e300b247-2d72-4ba8-acdc-dfe8f63bc7fb]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ssos906tdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:16 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ssos906tdevstack@QuobyteHD Nov 06 18:45:16 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:16 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ssos906tdevstack@QuobyteHD" returned: 0 in 0.671s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:16 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2da4fab-02b1-48c3-9965-cc772f8ff31c" returned: 0 in 8.571s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:16 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b, size 1024.00 MB, duration 8.57 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2da4fab-02b1-48c3-9965-cc772f8ff31c {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:45:16 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Converted 1024.00 MB image at 119.46 MB/s Nov 06 18:45:16 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2da4fab-02b1-48c3-9965-cc772f8ff31c is being set with open permissions: ugo+rw Nov 06 18:45:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2da4fab-02b1-48c3-9965-cc772f8ff31c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:16 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2da4fab-02b1-48c3-9965-cc772f8ff31c Nov 06 18:45:16 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:17 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2da4fab-02b1-48c3-9965-cc772f8ff31c" returned: 0 in 0.261s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Lock "cinder-quobyte-e2da4fab-02b1-48c3-9965-cc772f8ff31c" released by "_copy_volume_from_snapshot" :: held 10.007s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Acquiring lock "cinder-quobyte-0ed018f8-e4f2-4fc2-add6-3d446754d0cf" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Lock "cinder-quobyte-0ed018f8-e4f2-4fc2-add6-3d446754d0cf" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Deleting offline snapshot 0ed018f8-e4f2-4fc2-add6-3d446754d0cf of volume 3917bbf3-958a-4622-95b8-7501d4e1b55b {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:45:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] snapshot_file for this snap is: volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:45:17 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[f057b3ed-fa11-480c-80d4-e115a28faf5b]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:17 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf Nov 06 18:45:17 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:17 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf" returned: 0 in 0.415s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3917bbf3-958a-4622-95b8-7501d4e1b55b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:45:17 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[432dcebb-934e-4a8d-afeb-4629e727ebe9]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:17 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b Nov 06 18:45:17 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:18 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b" returned: 0 in 0.535s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:18 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf Nov 06 18:45:18 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:18 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf" returned: 0 in 0.383s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:18 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf Nov 06 18:45:18 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:18 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b.0ed018f8-e4f2-4fc2-add6-3d446754d0cf" returned: 0 in 0.251s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Lock "cinder-quobyte-0ed018f8-e4f2-4fc2-add6-3d446754d0cf" released by "_delete_snapshot" :: held 1.713s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.262s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-c87b9177-b964-4f5f-9a75-6de0ae790562 req-5e9af3d9-ec15-4250-ba79-39ad2cb08724 tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.342s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-c87b9177-b964-4f5f-9a75-6de0ae790562 req-5e9af3d9-ec15-4250-ba79-39ad2cb08724 tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.269s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-728575814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0c2d75-7d85-4bdc-b67f-4e071459bd36,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='034d99ffb5614dafa26e0f668401247b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:14Z,use_quota=True,user_id='74ddfdab2949404d8297e23626514f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Creating volume 2f0c2d75-7d85-4bdc-b67f-4e071459bd36 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:45:18 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9488901-d7ac-46f8-8053-594b141716a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2da4fab-02b1-48c3-9965-cc772f8ff31c', 'volume_size': 2, 'source_volid': '3917bbf3-958a-4622-95b8-7501d4e1b55b', 'source_volstatus': 'available'}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d1feea2-7ea7-440a-a64d-0c8eb6e6d15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:18 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36 1073741824 Nov 06 18:45:18 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:18 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Volume volume-e2da4fab-02b1-48c3-9965-cc772f8ff31c (e2da4fab-02b1-48c3-9965-cc772f8ff31c): created successfully Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d1feea2-7ea7-440a-a64d-0c8eb6e6d15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Flow 'volume_create_manager' (f2188e35-be94-4eca-b2b0-ed9692b5c6b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-c87b9177-b964-4f5f-9a75-6de0ae790562 req-5e9af3d9-ec15-4250-ba79-39ad2cb08724 tempest-TestInstancesWithCinderVolumes-1982719473 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-6a87e136-5f3f-4712-a596-538b8b41f5ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a46f6b14-bac8-4a5e-a3c0-f87dcd021424', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:45:19 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-285ec532-7989-41e0-a19d-335537fc1552 tempest-VolumesCloneTest-1631173854 None] Created volume successfully. Nov 06 18:45:19 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-c87b9177-b964-4f5f-9a75-6de0ae790562 req-5e9af3d9-ec15-4250-ba79-39ad2cb08724 tempest-TestInstancesWithCinderVolumes-1982719473 None] attachment_update completed successfully. Nov 06 18:45:19 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36 1073741824" returned: 0 in 0.654s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:19 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36 Nov 06 18:45:19 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2748bbf4-c9b5-4f0d-8ca9-dda6e2f6f791 tempest-VolumesCloneTest-1631173854 None] Acquiring lock "cinder-e2da4fab-02b1-48c3-9965-cc772f8ff31c-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2748bbf4-c9b5-4f0d-8ca9-dda6e2f6f791 tempest-VolumesCloneTest-1631173854 None] Lock "cinder-e2da4fab-02b1-48c3-9965-cc772f8ff31c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2748bbf4-c9b5-4f0d-8ca9-dda6e2f6f791 tempest-VolumesCloneTest-1631173854 None] Acquiring lock "cinder-quobyte-e2da4fab-02b1-48c3-9965-cc772f8ff31c" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2748bbf4-c9b5-4f0d-8ca9-dda6e2f6f791 tempest-VolumesCloneTest-1631173854 None] Lock "cinder-quobyte-e2da4fab-02b1-48c3-9965-cc772f8ff31c" acquired by "delete_volume" :: waited 0.030s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:19 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc8d44f-74a8-4c02-b724-085f0f360bd7]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2748bbf4-c9b5-4f0d-8ca9-dda6e2f6f791 tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2da4fab-02b1-48c3-9965-cc772f8ff31c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:20 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36" returned: 0 in 0.403s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Attempting download of 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}])) to volume 2f0c2d75-7d85-4bdc-b67f-4e071459bd36. {{(pid=86794) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 18:45:20 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2da4fab-02b1-48c3-9965-cc772f8ff31c Nov 06 18:45:20 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a5d9a2-2359-48bc-ac48-e6df1cc1fbc9]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_jw3821fi {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:20 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_jw3821fi Nov 06 18:45:20 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:20 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2748bbf4-c9b5-4f0d-8ca9-dda6e2f6f791 tempest-VolumesCloneTest-1631173854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2da4fab-02b1-48c3-9965-cc772f8ff31c" returned: 0 in 0.415s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2748bbf4-c9b5-4f0d-8ca9-dda6e2f6f791 tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2da4fab-02b1-48c3-9965-cc772f8ff31c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:20 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2da4fab-02b1-48c3-9965-cc772f8ff31c Nov 06 18:45:20 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:20 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_jw3821fi" returned: 0 in 0.379s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_jw3821fi {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:20 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_jw3821fi Nov 06 18:45:20 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:20 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2748bbf4-c9b5-4f0d-8ca9-dda6e2f6f791 tempest-VolumesCloneTest-1631173854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e2da4fab-02b1-48c3-9965-cc772f8ff31c" returned: 0 in 0.301s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2748bbf4-c9b5-4f0d-8ca9-dda6e2f6f791 tempest-VolumesCloneTest-1631173854 None] Lock "cinder-quobyte-e2da4fab-02b1-48c3-9965-cc772f8ff31c" released by "delete_volume" :: held 0.782s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-2748bbf4-c9b5-4f0d-8ca9-dda6e2f6f791 tempest-VolumesCloneTest-1631173854 None] Created reservations ['e09b41bb-7b02-4961-9292-8f0aadf2ee30', '7def1d7a-497f-4479-977f-266d2a2b3f0f', 'cfe098b1-6ba4-44ef-bfa3-764a00525187', '168fc48b-bb45-4412-843f-eb742d0712b4'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2748bbf4-c9b5-4f0d-8ca9-dda6e2f6f791 tempest-VolumesCloneTest-1631173854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2748bbf4-c9b5-4f0d-8ca9-dda6e2f6f791 tempest-VolumesCloneTest-1631173854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2748bbf4-c9b5-4f0d-8ca9-dda6e2f6f791 tempest-VolumesCloneTest-1631173854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2748bbf4-c9b5-4f0d-8ca9-dda6e2f6f791 tempest-VolumesCloneTest-1631173854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2748bbf4-c9b5-4f0d-8ca9-dda6e2f6f791 tempest-VolumesCloneTest-1631173854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2748bbf4-c9b5-4f0d-8ca9-dda6e2f6f791 tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:20 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_jw3821fi" returned: 1 in 0.407s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_jw3821fi' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:45:20 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:45:20 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46c6cbf-4df0-4859-99f7-361cb9e9323a]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ssos906tdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:21 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ssos906tdevstack@QuobyteHD Nov 06 18:45:21 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-cbdb4021-6d93-44ef-a047-dabdd2d41c92 tempest-VolumesCloneTest-1631173854 None] Acquiring lock "cinder-3917bbf3-958a-4622-95b8-7501d4e1b55b-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-cbdb4021-6d93-44ef-a047-dabdd2d41c92 tempest-VolumesCloneTest-1631173854 None] Lock "cinder-3917bbf3-958a-4622-95b8-7501d4e1b55b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-cbdb4021-6d93-44ef-a047-dabdd2d41c92 tempest-VolumesCloneTest-1631173854 None] Acquiring lock "cinder-quobyte-3917bbf3-958a-4622-95b8-7501d4e1b55b" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-cbdb4021-6d93-44ef-a047-dabdd2d41c92 tempest-VolumesCloneTest-1631173854 None] Lock "cinder-quobyte-3917bbf3-958a-4622-95b8-7501d4e1b55b" acquired by "delete_volume" :: waited 0.037s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:21 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3107003-8c1b-4871-b977-410dc8972c84]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cbdb4021-6d93-44ef-a047-dabdd2d41c92 tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:21 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2748bbf4-c9b5-4f0d-8ca9-dda6e2f6f791 tempest-VolumesCloneTest-1631173854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.595s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:21 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-2748bbf4-c9b5-4f0d-8ca9-dda6e2f6f791 tempest-VolumesCloneTest-1631173854 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:45:21 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-2748bbf4-c9b5-4f0d-8ca9-dda6e2f6f791 tempest-VolumesCloneTest-1631173854 None] Deleted volume successfully. Nov 06 18:45:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2748bbf4-c9b5-4f0d-8ca9-dda6e2f6f791 tempest-VolumesCloneTest-1631173854 None] Lock "cinder-e2da4fab-02b1-48c3-9965-cc772f8ff31c-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:21 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b Nov 06 18:45:21 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:21 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ssos906tdevstack@QuobyteHD" returned: 0 in 0.712s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:21 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 was qcow2, converting to qcow2 {{(pid=86794) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 18:45:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ssos906tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:21 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ssos906tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36 Nov 06 18:45:21 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:21 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cbdb4021-6d93-44ef-a047-dabdd2d41c92 tempest-VolumesCloneTest-1631173854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b" returned: 0 in 0.553s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cbdb4021-6d93-44ef-a047-dabdd2d41c92 tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:22 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b Nov 06 18:45:22 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-4e4079f3-318a-4e88-938a-a7b58230dfc0 req-23176ed2-ab31-40c5-bf9f-58aa09cedbca tempest-TestInstancesWithCinderVolumes-1982719473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-4e4079f3-318a-4e88-938a-a7b58230dfc0 req-23176ed2-ab31-40c5-bf9f-58aa09cedbca tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-4e4079f3-318a-4e88-938a-a7b58230dfc0 req-23176ed2-ab31-40c5-bf9f-58aa09cedbca tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:22 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-4e4079f3-318a-4e88-938a-a7b58230dfc0 req-23176ed2-ab31-40c5-bf9f-58aa09cedbca tempest-TestInstancesWithCinderVolumes-1982719473 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-b85855a9-fd40-4000-810f-5ceb9f3ae1f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2bb5b6fd-a6f2-4fbe-ac32-d6d9d6ea6588', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:45:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-4e4079f3-318a-4e88-938a-a7b58230dfc0 req-23176ed2-ab31-40c5-bf9f-58aa09cedbca tempest-TestInstancesWithCinderVolumes-1982719473 None] attachment_update completed successfully. Nov 06 18:45:22 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cbdb4021-6d93-44ef-a047-dabdd2d41c92 tempest-VolumesCloneTest-1631173854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3917bbf3-958a-4622-95b8-7501d4e1b55b" returned: 0 in 0.399s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-cbdb4021-6d93-44ef-a047-dabdd2d41c92 tempest-VolumesCloneTest-1631173854 None] Lock "cinder-quobyte-3917bbf3-958a-4622-95b8-7501d4e1b55b" released by "delete_volume" :: held 1.086s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:22 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-cbdb4021-6d93-44ef-a047-dabdd2d41c92 tempest-VolumesCloneTest-1631173854 None] Created reservations ['26b9f217-df0a-4958-b81f-a4e86cc6884c', '104a1b90-a543-4ecf-8a0e-22443fc74b7b', '8cff7695-d55c-4ff2-8dff-eabddec9d057', 'cbee5356-4f9d-40cb-8298-6a9e918340b8'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:45:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cbdb4021-6d93-44ef-a047-dabdd2d41c92 tempest-VolumesCloneTest-1631173854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cbdb4021-6d93-44ef-a047-dabdd2d41c92 tempest-VolumesCloneTest-1631173854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:22 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cbdb4021-6d93-44ef-a047-dabdd2d41c92 tempest-VolumesCloneTest-1631173854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:22 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cbdb4021-6d93-44ef-a047-dabdd2d41c92 tempest-VolumesCloneTest-1631173854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cbdb4021-6d93-44ef-a047-dabdd2d41c92 tempest-VolumesCloneTest-1631173854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cbdb4021-6d93-44ef-a047-dabdd2d41c92 tempest-VolumesCloneTest-1631173854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:22 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:45:22 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:23 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cbdb4021-6d93-44ef-a047-dabdd2d41c92 tempest-VolumesCloneTest-1631173854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.460s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:23 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cbdb4021-6d93-44ef-a047-dabdd2d41c92 tempest-VolumesCloneTest-1631173854 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:45:23 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-cbdb4021-6d93-44ef-a047-dabdd2d41c92 tempest-VolumesCloneTest-1631173854 None] Deleted volume successfully. Nov 06 18:45:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-cbdb4021-6d93-44ef-a047-dabdd2d41c92 tempest-VolumesCloneTest-1631173854 None] Lock "cinder-3917bbf3-958a-4622-95b8-7501d4e1b55b-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:24 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ssos906tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36" returned: 0 in 2.723s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:24 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_ssos906tdevstack@QuobyteHD, size 112.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36 {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:45:24 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Converted 112.00 MB image at 41.12 MB/s Nov 06 18:45:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:24 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36 1G Nov 06 18:45:24 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:24 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36 1G" returned: 0 in 0.459s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:24 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Downloaded image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}])) to volume 2f0c2d75-7d85-4bdc-b67f-4e071459bd36 successfully. {{(pid=86794) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 18:45:24 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Temporary image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 for user 74ddfdab2949404d8297e23626514f70 is deleted. {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 18:45:24 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Marking volume 2f0c2d75-7d85-4bdc-b67f-4e071459bd36 as bootable. {{(pid=86794) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 18:45:24 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Copying metadata from image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 to 2f0c2d75-7d85-4bdc-b67f-4e071459bd36. {{(pid=86794) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 18:45:24 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Creating volume glance metadata for volume 2f0c2d75-7d85-4bdc-b67f-4e071459bd36 backed by image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86794) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 18:45:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb93753-cb7d-4463-9caf-8a8b61ef287f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36', 'volume_size': 1, 'image_id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d57c6da8e464b1a80cefabe6e3cfecd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'created_at': datetime.datetime(2026, 11, 6, 17, 27, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 27, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3a2ee2-7ad8-45ce-b43c-d6483ad8340c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:25 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Volume volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36 (2f0c2d75-7d85-4bdc-b67f-4e071459bd36): created successfully Nov 06 18:45:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3a2ee2-7ad8-45ce-b43c-d6483ad8340c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Flow 'volume_create_manager' (ad98f9bb-d12c-4de4-a827-a859086d32d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:25 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-eefaad45-813a-4a09-82a8-9b5fdfce331c tempest-VolumesGetTest-1608161745 None] Created volume successfully. Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Flow 'volume_create_manager' (9be54d22-0cf2-4df8-b514-cd2af72f32c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22ef825-cc22-460f-bd9d-6a5a75e31855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22ef825-cc22-460f-bd9d-6a5a75e31855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1722563773',display_name='tempest-VolumesGetTest-Volume-683445675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d107e45f-3331-455d-bfe7-3021676dedb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034d99ffb5614dafa26e0f668401247b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:27Z,use_quota=True,user_id='74ddfdab2949404d8297e23626514f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818cf8bf-dfb5-478f-9d92-86cbb56d558b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818cf8bf-dfb5-478f-9d92-86cbb56d558b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7951df8e-986a-4d46-8fec-32f4859f4765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7951df8e-986a-4d46-8fec-32f4859f4765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd107e45f-3331-455d-bfe7-3021676dedb5', 'volume_name': 'volume-d107e45f-3331-455d-bfe7-3021676dedb5', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66d5352-8ac9-452d-a354-0f782796ef96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66d5352-8ac9-452d-a354-0f782796ef96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb8c082-29ca-4bd5-8311-052f24769c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:27 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Volume d107e45f-3331-455d-bfe7-3021676dedb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d107e45f-3331-455d-bfe7-3021676dedb5', 'volume_size': 1} Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1722563773',display_name='tempest-VolumesGetTest-Volume-683445675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d107e45f-3331-455d-bfe7-3021676dedb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034d99ffb5614dafa26e0f668401247b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:27Z,use_quota=True,user_id='74ddfdab2949404d8297e23626514f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Creating volume d107e45f-3331-455d-bfe7-3021676dedb5 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:45:27 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d107e45f-3331-455d-bfe7-3021676dedb5 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:27 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d107e45f-3331-455d-bfe7-3021676dedb5 1073741824 Nov 06 18:45:27 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:27 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d107e45f-3331-455d-bfe7-3021676dedb5 1073741824" returned: 0 in 0.611s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d107e45f-3331-455d-bfe7-3021676dedb5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:28 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d107e45f-3331-455d-bfe7-3021676dedb5 Nov 06 18:45:28 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:28 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d107e45f-3331-455d-bfe7-3021676dedb5" returned: 0 in 0.404s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb8c082-29ca-4bd5-8311-052f24769c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d107e45f-3331-455d-bfe7-3021676dedb5', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d6130a-f7ea-4674-9363-70a7d7900e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:28 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Volume volume-d107e45f-3331-455d-bfe7-3021676dedb5 (d107e45f-3331-455d-bfe7-3021676dedb5): created successfully Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d6130a-f7ea-4674-9363-70a7d7900e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Flow 'volume_create_manager' (9be54d22-0cf2-4df8-b514-cd2af72f32c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:28 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-6f21d570-2a3f-481e-966f-baec92bef9bc tempest-VolumesGetTest-1608161745 None] Created volume successfully. Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Flow 'volume_create_manager' (a6980263-7f90-4fa3-b203-dd0f98b338df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf9ca0b-5f8e-442a-8657-efdfb9c03247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf9ca0b-5f8e-442a-8657-efdfb9c03247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-429130038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8b23172-cf13-4072-82b2-66e095421866,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='70321ebb1ff3447a96b1d18db045ab60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:29Z,use_quota=True,user_id='c691a35c753b4a52bfa13affd8411cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be6f474-9a67-4336-b170-296609c4d4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be6f474-9a67-4336-b170-296609c4d4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7253a5-0b05-4ca2-8584-29090c256b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7253a5-0b05-4ca2-8584-29090c256b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8b23172-cf13-4072-82b2-66e095421866', 'volume_name': 'volume-f8b23172-cf13-4072-82b2-66e095421866', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf77b330-824d-4f49-9c9c-0236b1fe2f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf77b330-824d-4f49-9c9c-0236b1fe2f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f9891b-5884-442b-8335-71ffd33d9e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:28 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Volume f8b23172-cf13-4072-82b2-66e095421866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8b23172-cf13-4072-82b2-66e095421866', 'volume_size': 1} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-429130038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8b23172-cf13-4072-82b2-66e095421866,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='70321ebb1ff3447a96b1d18db045ab60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:29Z,use_quota=True,user_id='c691a35c753b4a52bfa13affd8411cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Creating volume f8b23172-cf13-4072-82b2-66e095421866 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:45:28 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:45:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f8b23172-cf13-4072-82b2-66e095421866 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:28 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f8b23172-cf13-4072-82b2-66e095421866 1073741824 Nov 06 18:45:28 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:29 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:45:29 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:29 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-289bf7b4-dbe1-495f-88cf-9892d013b340 req-f6d8335b-ebc5-4a0e-9f76-5f8f6ef1909a tempest-TestInstancesWithCinderVolumes-1982719473 None] Terminate volume connection completed successfully. Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-289bf7b4-dbe1-495f-88cf-9892d013b340 req-f6d8335b-ebc5-4a0e-9f76-5f8f6ef1909a tempest-TestInstancesWithCinderVolumes-1982719473 None] Deleting attachment a46f6b14-bac8-4a5e-a3c0-f87dcd021424. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:45:29 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.446s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 29 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:45:29 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9738d6e5-1dd8-4720-ac01-7e56e91787d9 tempest-VolumesGetTest-1608161745 None] Acquiring lock "cinder-d107e45f-3331-455d-bfe7-3021676dedb5-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f8b23172-cf13-4072-82b2-66e095421866 1073741824" returned: 0 in 0.821s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9738d6e5-1dd8-4720-ac01-7e56e91787d9 tempest-VolumesGetTest-1608161745 None] Lock "cinder-d107e45f-3331-455d-bfe7-3021676dedb5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f8b23172-cf13-4072-82b2-66e095421866 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:29 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f8b23172-cf13-4072-82b2-66e095421866 Nov 06 18:45:29 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9738d6e5-1dd8-4720-ac01-7e56e91787d9 tempest-VolumesGetTest-1608161745 None] Acquiring lock "cinder-quobyte-d107e45f-3331-455d-bfe7-3021676dedb5" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9738d6e5-1dd8-4720-ac01-7e56e91787d9 tempest-VolumesGetTest-1608161745 None] Lock "cinder-quobyte-d107e45f-3331-455d-bfe7-3021676dedb5" acquired by "delete_volume" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8070987-935a-45af-bb30-ff643d23acd1]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9738d6e5-1dd8-4720-ac01-7e56e91787d9 tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d107e45f-3331-455d-bfe7-3021676dedb5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] Acquiring lock "cinder-6a87e136-5f3f-4712-a596-538b8b41f5ba-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "cinder-6a87e136-5f3f-4712-a596-538b8b41f5ba-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] Acquiring lock "cinder-quobyte-6a87e136-5f3f-4712-a596-538b8b41f5ba" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:30 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d107e45f-3331-455d-bfe7-3021676dedb5 Nov 06 18:45:30 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "cinder-quobyte-6a87e136-5f3f-4712-a596-538b8b41f5ba" acquired by "delete_volume" :: waited 0.033s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:30 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f8b23172-cf13-4072-82b2-66e095421866" returned: 0 in 0.332s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:45:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f9891b-5884-442b-8335-71ffd33d9e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8b23172-cf13-4072-82b2-66e095421866', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a4ab28-f2da-4b34-a84f-0ecb2503a0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:30 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99f74c7-7d07-4749-9c2d-074170f2e5d0]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6a87e136-5f3f-4712-a596-538b8b41f5ba {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:30 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Volume volume-f8b23172-cf13-4072-82b2-66e095421866 (f8b23172-cf13-4072-82b2-66e095421866): created successfully Nov 06 18:45:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a4ab28-f2da-4b34-a84f-0ecb2503a0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Flow 'volume_create_manager' (a6980263-7f90-4fa3-b203-dd0f98b338df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:30 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-f8ff12d8-4f41-4243-8e58-10dc67eea093 tempest-VolumesListTestJSON-2052757374 None] Created volume successfully. Nov 06 18:45:30 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6a87e136-5f3f-4712-a596-538b8b41f5ba Nov 06 18:45:30 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:30 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9738d6e5-1dd8-4720-ac01-7e56e91787d9 tempest-VolumesGetTest-1608161745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d107e45f-3331-455d-bfe7-3021676dedb5" returned: 0 in 0.532s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9738d6e5-1dd8-4720-ac01-7e56e91787d9 tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d107e45f-3331-455d-bfe7-3021676dedb5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:30 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d107e45f-3331-455d-bfe7-3021676dedb5 Nov 06 18:45:30 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:30 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6a87e136-5f3f-4712-a596-538b8b41f5ba" returned: 0 in 0.478s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6a87e136-5f3f-4712-a596-538b8b41f5ba {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:30 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6a87e136-5f3f-4712-a596-538b8b41f5ba Nov 06 18:45:30 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:30 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9738d6e5-1dd8-4720-ac01-7e56e91787d9 tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d107e45f-3331-455d-bfe7-3021676dedb5" returned: 0 in 0.341s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9738d6e5-1dd8-4720-ac01-7e56e91787d9 tempest-VolumesGetTest-1608161745 None] Lock "cinder-quobyte-d107e45f-3331-455d-bfe7-3021676dedb5" released by "delete_volume" :: held 0.938s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:30 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-9738d6e5-1dd8-4720-ac01-7e56e91787d9 tempest-VolumesGetTest-1608161745 None] Created reservations ['e14cc17b-8118-41d4-bd5e-11097a4d7874', 'b3f3122a-64bb-4de7-8c5b-0e7421205734', '8bc6b7d3-ac20-4609-b042-2ba96321b788', '0e99e33a-69e5-4f6e-93b1-5d02ec83e962'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9738d6e5-1dd8-4720-ac01-7e56e91787d9 tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9738d6e5-1dd8-4720-ac01-7e56e91787d9 tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9738d6e5-1dd8-4720-ac01-7e56e91787d9 tempest-VolumesGetTest-1608161745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9738d6e5-1dd8-4720-ac01-7e56e91787d9 tempest-VolumesGetTest-1608161745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9738d6e5-1dd8-4720-ac01-7e56e91787d9 tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9738d6e5-1dd8-4720-ac01-7e56e91787d9 tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:31 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6a87e136-5f3f-4712-a596-538b8b41f5ba" returned: 0 in 0.440s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:31 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:45:31 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "cinder-quobyte-6a87e136-5f3f-4712-a596-538b8b41f5ba" released by "delete_volume" :: held 1.003s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:31 devstack cinder-volume[86794]: WARNING cinder.quota [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-777401586-2000401654 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-777401586-2000401654, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:45:31 devstack cinder-volume[86794]: WARNING cinder.quota [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-777401586-2000401654 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-777401586-2000401654, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] Created reservations ['1b84cb9a-be4f-47e1-9c33-6364e51780be', 'e9a82abe-68f9-41c7-8eb9-8ff45afd07f1', '7909c118-469a-4a0f-b004-2d52502a00a9', '983e6018-9a07-459c-ab96-8f893d8c62b4'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:31 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:45:31 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:31 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9738d6e5-1dd8-4720-ac01-7e56e91787d9 tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.486s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-9738d6e5-1dd8-4720-ac01-7e56e91787d9 tempest-VolumesGetTest-1608161745 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:45:31 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-9738d6e5-1dd8-4720-ac01-7e56e91787d9 tempest-VolumesGetTest-1608161745 None] Deleted volume successfully. Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9738d6e5-1dd8-4720-ac01-7e56e91787d9 tempest-VolumesGetTest-1608161745 None] Lock "cinder-d107e45f-3331-455d-bfe7-3021676dedb5-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:45:31 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Flow 'volume_create_manager' (13da6950-1820-41ba-8909-ba8c37fea078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544a5000-73e0-4504-ada5-4904c0b88232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.359s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544a5000-73e0-4504-ada5-4904c0b88232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-214001700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cbc6781-5b08-487a-a794-defd937d8bbc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='70321ebb1ff3447a96b1d18db045ab60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:32Z,use_quota=True,user_id='c691a35c753b4a52bfa13affd8411cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d7b1b74-cf38-4fd8-a0c3-8b38cd9d32f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d7b1b74-cf38-4fd8-a0c3-8b38cd9d32f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a94d10d-553d-4fa6-b906-76789a8ae07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a94d10d-553d-4fa6-b906-76789a8ae07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cbc6781-5b08-487a-a794-defd937d8bbc', 'volume_name': 'volume-9cbc6781-5b08-487a-a794-defd937d8bbc', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c19b275-52ea-4c87-88bc-406e4af6d07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c19b275-52ea-4c87-88bc-406e4af6d07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e705d987-af66-4eb2-95e2-072e4bdacdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:31 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Volume 9cbc6781-5b08-487a-a794-defd937d8bbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cbc6781-5b08-487a-a794-defd937d8bbc', 'volume_size': 1} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-214001700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cbc6781-5b08-487a-a794-defd937d8bbc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='70321ebb1ff3447a96b1d18db045ab60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:32Z,use_quota=True,user_id='c691a35c753b4a52bfa13affd8411cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Creating volume 9cbc6781-5b08-487a-a794-defd937d8bbc {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:45:31 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9cbc6781-5b08-487a-a794-defd937d8bbc 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:31 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] Deleted volume successfully. Nov 06 18:45:31 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9cbc6781-5b08-487a-a794-defd937d8bbc 1073741824 Nov 06 18:45:31 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:31 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9e3d1c79-9e50-41c9-898f-461eb74f9d44 tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "cinder-6a87e136-5f3f-4712-a596-538b8b41f5ba-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1e816cb8-9a53-4ed9-a5a2-999a78df07fa tempest-VolumesGetTest-1608161745 None] Acquiring lock "cinder-2f0c2d75-7d85-4bdc-b67f-4e071459bd36-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1e816cb8-9a53-4ed9-a5a2-999a78df07fa tempest-VolumesGetTest-1608161745 None] Lock "cinder-2f0c2d75-7d85-4bdc-b67f-4e071459bd36-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1e816cb8-9a53-4ed9-a5a2-999a78df07fa tempest-VolumesGetTest-1608161745 None] Acquiring lock "cinder-quobyte-2f0c2d75-7d85-4bdc-b67f-4e071459bd36" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1e816cb8-9a53-4ed9-a5a2-999a78df07fa tempest-VolumesGetTest-1608161745 None] Lock "cinder-quobyte-2f0c2d75-7d85-4bdc-b67f-4e071459bd36" acquired by "delete_volume" :: waited 0.024s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:32 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[814aad1e-2ea2-4f77-9099-10869ffa7f3f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1e816cb8-9a53-4ed9-a5a2-999a78df07fa tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:32 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9cbc6781-5b08-487a-a794-defd937d8bbc 1073741824" returned: 0 in 0.579s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:32 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36 Nov 06 18:45:32 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9cbc6781-5b08-487a-a794-defd937d8bbc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:32 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9cbc6781-5b08-487a-a794-defd937d8bbc Nov 06 18:45:32 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:32 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1e816cb8-9a53-4ed9-a5a2-999a78df07fa tempest-VolumesGetTest-1608161745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36" returned: 0 in 0.489s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1e816cb8-9a53-4ed9-a5a2-999a78df07fa tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:32 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9cbc6781-5b08-487a-a794-defd937d8bbc" returned: 0 in 0.330s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:32 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:45:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:32 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36 Nov 06 18:45:32 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e705d987-af66-4eb2-95e2-072e4bdacdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cbc6781-5b08-487a-a794-defd937d8bbc', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4dd64c-7562-4f9d-a848-2a5b8a6414bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:32 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Volume volume-9cbc6781-5b08-487a-a794-defd937d8bbc (9cbc6781-5b08-487a-a794-defd937d8bbc): created successfully Nov 06 18:45:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4dd64c-7562-4f9d-a848-2a5b8a6414bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Flow 'volume_create_manager' (13da6950-1820-41ba-8909-ba8c37fea078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:32 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-dd936729-f457-49d9-8704-5f63a5dfe20c tempest-VolumesListTestJSON-2052757374 None] Created volume successfully. Nov 06 18:45:33 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1e816cb8-9a53-4ed9-a5a2-999a78df07fa tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f0c2d75-7d85-4bdc-b67f-4e071459bd36" returned: 0 in 0.284s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:33 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1e816cb8-9a53-4ed9-a5a2-999a78df07fa tempest-VolumesGetTest-1608161745 None] Lock "cinder-quobyte-2f0c2d75-7d85-4bdc-b67f-4e071459bd36" released by "delete_volume" :: held 0.831s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:33 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-1e816cb8-9a53-4ed9-a5a2-999a78df07fa tempest-VolumesGetTest-1608161745 None] Created reservations ['ea213ace-1e68-46ba-9927-265b9128e37b', '6d2be7ca-e3f4-443e-844c-4a686227ba59', 'b42c2987-7356-434d-ba77-e66f4c726099', '9db7f0e8-5d84-44be-b3a3-9f70bff7659e'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:45:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1e816cb8-9a53-4ed9-a5a2-999a78df07fa tempest-VolumesGetTest-1608161745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1e816cb8-9a53-4ed9-a5a2-999a78df07fa tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1e816cb8-9a53-4ed9-a5a2-999a78df07fa tempest-VolumesGetTest-1608161745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1e816cb8-9a53-4ed9-a5a2-999a78df07fa tempest-VolumesGetTest-1608161745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1e816cb8-9a53-4ed9-a5a2-999a78df07fa tempest-VolumesGetTest-1608161745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1e816cb8-9a53-4ed9-a5a2-999a78df07fa tempest-VolumesGetTest-1608161745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:33 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:45:33 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:33 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1e816cb8-9a53-4ed9-a5a2-999a78df07fa tempest-VolumesGetTest-1608161745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.283s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:33 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-1e816cb8-9a53-4ed9-a5a2-999a78df07fa tempest-VolumesGetTest-1608161745 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:45:33 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-1e816cb8-9a53-4ed9-a5a2-999a78df07fa tempest-VolumesGetTest-1608161745 None] Deleted volume successfully. Nov 06 18:45:33 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1e816cb8-9a53-4ed9-a5a2-999a78df07fa tempest-VolumesGetTest-1608161745 None] Lock "cinder-2f0c2d75-7d85-4bdc-b67f-4e071459bd36-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Flow 'volume_create_manager' (de5ff8ba-c743-4e4e-984d-257e7dc1f168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11eef40a-5623-4ae0-b732-68663c714fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11eef40a-5623-4ae0-b732-68663c714fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-273747526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b03686b-f688-4a71-96a2-e83ab3ae0b68,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='70321ebb1ff3447a96b1d18db045ab60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:34Z,use_quota=True,user_id='c691a35c753b4a52bfa13affd8411cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41fbe433-45f0-4f49-830a-d41c4e7a747d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41fbe433-45f0-4f49-830a-d41c4e7a747d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba2ba4f-aca6-4222-b7b8-11d1e0c95525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba2ba4f-aca6-4222-b7b8-11d1e0c95525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b03686b-f688-4a71-96a2-e83ab3ae0b68', 'volume_name': 'volume-0b03686b-f688-4a71-96a2-e83ab3ae0b68', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d03ecad-eded-4686-ba60-935925ee0ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d03ecad-eded-4686-ba60-935925ee0ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (374f308c-cd1b-4fff-94c0-1f42bafe0550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:34 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Volume 0b03686b-f688-4a71-96a2-e83ab3ae0b68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b03686b-f688-4a71-96a2-e83ab3ae0b68', 'volume_size': 1} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-273747526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b03686b-f688-4a71-96a2-e83ab3ae0b68,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='70321ebb1ff3447a96b1d18db045ab60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:34Z,use_quota=True,user_id='c691a35c753b4a52bfa13affd8411cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Creating volume 0b03686b-f688-4a71-96a2-e83ab3ae0b68 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:45:34 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0b03686b-f688-4a71-96a2-e83ab3ae0b68 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:34 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0b03686b-f688-4a71-96a2-e83ab3ae0b68 1073741824 Nov 06 18:45:34 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:34 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-8b0fd14e-db7e-4ddb-825e-a83111800784 req-153f3e99-430c-4853-87f3-d44dadd4a2f5 tempest-TestInstancesWithCinderVolumes-1982719473 None] Terminate volume connection completed successfully. Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-8b0fd14e-db7e-4ddb-825e-a83111800784 req-153f3e99-430c-4853-87f3-d44dadd4a2f5 tempest-TestInstancesWithCinderVolumes-1982719473 None] Deleting attachment 2bb5b6fd-a6f2-4fbe-ac32-d6d9d6ea6588. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Flow 'volume_create_manager' (6646896a-7f51-4083-ad38-6a9b8b84e8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b7d2ad3-cb29-4aa0-a5ea-9b89a035256f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b7d2ad3-cb29-4aa0-a5ea-9b89a035256f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-484942920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69842e92-0cdd-48c2-a98f-2ca2d89bc3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e326ecf1997847fe92e9964070df1659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:35Z,use_quota=True,user_id='77821379e8aa44f3b8f94376c7233786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540fa8b6-9e8f-4a89-b05b-e58edd73dc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540fa8b6-9e8f-4a89-b05b-e58edd73dc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1541d6-78c3-4865-bc0a-1826f1ca802a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:34 devstack cinder-volume[86794]: DEBUG cinder.image.glance [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Creating Keystone auth plugin from conf {{(pid=86794) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 18:45:35 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0b03686b-f688-4a71-96a2-e83ab3ae0b68 1073741824" returned: 0 in 0.595s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0b03686b-f688-4a71-96a2-e83ab3ae0b68 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:35 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0b03686b-f688-4a71-96a2-e83ab3ae0b68 Nov 06 18:45:35 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] Acquiring lock "cinder-b85855a9-fd40-4000-810f-5ceb9f3ae1f4-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "cinder-b85855a9-fd40-4000-810f-5ceb9f3ae1f4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] Acquiring lock "cinder-quobyte-b85855a9-fd40-4000-810f-5ceb9f3ae1f4" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "cinder-quobyte-b85855a9-fd40-4000-810f-5ceb9f3ae1f4" acquired by "delete_volume" :: waited 0.037s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e82277f-80e2-4a15-9a57-f89c7e2426f4]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b85855a9-fd40-4000-810f-5ceb9f3ae1f4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:35 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0b03686b-f688-4a71-96a2-e83ab3ae0b68" returned: 0 in 0.358s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (374f308c-cd1b-4fff-94c0-1f42bafe0550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b03686b-f688-4a71-96a2-e83ab3ae0b68', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15630be-49f5-400a-a882-5a7cddc9d0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:35 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b85855a9-fd40-4000-810f-5ceb9f3ae1f4 Nov 06 18:45:35 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:35 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Volume volume-0b03686b-f688-4a71-96a2-e83ab3ae0b68 (0b03686b-f688-4a71-96a2-e83ab3ae0b68): created successfully Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15630be-49f5-400a-a882-5a7cddc9d0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Flow 'volume_create_manager' (de5ff8ba-c743-4e4e-984d-257e7dc1f168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:35 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-2c18a191-fae0-4787-af17-defdbc76ee3f tempest-VolumesListTestJSON-2052757374 None] Created volume successfully. Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1541d6-78c3-4865-bc0a-1826f1ca802a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '69842e92-0cdd-48c2-a98f-2ca2d89bc3dd', 'volume_name': 'volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd', 'volume_size': 1, 'image_id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d57c6da8e464b1a80cefabe6e3cfecd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'created_at': datetime.datetime(2026, 11, 6, 17, 27, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 27, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f24803c-22dd-4af2-8ee6-31f24f731c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f24803c-22dd-4af2-8ee6-31f24f731c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e028e10-b361-4bb2-b891-b34b9678469f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:35 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Volume 69842e92-0cdd-48c2-a98f-2ca2d89bc3dd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd', 'volume_size': 1, 'image_id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d57c6da8e464b1a80cefabe6e3cfecd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'created_at': datetime.datetime(2026, 11, 6, 17, 27, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 27, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Trying to clone 69842e92-0cdd-48c2-a98f-2ca2d89bc3dd from image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}]). {{(pid=86794) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 18:45:35 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b85855a9-fd40-4000-810f-5ceb9f3ae1f4" returned: 0 in 0.518s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b85855a9-fd40-4000-810f-5ceb9f3ae1f4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:35 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b85855a9-fd40-4000-810f-5ceb9f3ae1f4 Nov 06 18:45:35 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:36 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_1e5u_g6tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 18:45:36 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Image download 20.69 MB at 20.69 MB/s Nov 06 18:45:36 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7650b2c-511d-48b6-b729-4107477c13e7]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_1e5u_g6tdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:36 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b85855a9-fd40-4000-810f-5ceb9f3ae1f4" returned: 0 in 0.369s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "cinder-quobyte-b85855a9-fd40-4000-810f-5ceb9f3ae1f4" released by "delete_volume" :: held 0.974s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:36 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_1e5u_g6tdevstack@QuobyteHD Nov 06 18:45:36 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:36 devstack cinder-volume[86794]: WARNING cinder.quota [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1144828524-685600545 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1144828524-685600545, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:45:36 devstack cinder-volume[86794]: WARNING cinder.quota [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1144828524-685600545 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1144828524-685600545, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:45:36 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] Created reservations ['2d32932b-85af-4415-ac60-e24078cb22e5', 'cdc27937-da80-4980-a00b-8c1a3311bab7', '82770cbf-a18c-4492-ab34-1893fdad75ef', 'fb89f3b4-7c0f-4c44-85a8-bf68b3b9e8f2'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:45:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:36 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:45:36 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:36 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_1e5u_g6tdevstack@QuobyteHD" returned: 0 in 0.505s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:36 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Temporary image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 is fetched for user 77821379e8aa44f3b8f94376c7233786. {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 18:45:36 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccf12ae-7adc-4a44-b103-e5fc0792da53]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_1e5u_g6tdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:36 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.434s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:36 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:45:37 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] Deleted volume successfully. Nov 06 18:45:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-77699047-2669-491f-8ce2-9b954ddd8e1a tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "cinder-b85855a9-fd40-4000-810f-5ceb9f3ae1f4-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:37 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_1e5u_g6tdevstack@QuobyteHD Nov 06 18:45:37 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:37 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_1e5u_g6tdevstack@QuobyteHD" returned: 0 in 0.544s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-484942920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69842e92-0cdd-48c2-a98f-2ca2d89bc3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e326ecf1997847fe92e9964070df1659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:35Z,use_quota=True,user_id='77821379e8aa44f3b8f94376c7233786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:45:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Creating volume 69842e92-0cdd-48c2-a98f-2ca2d89bc3dd {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:45:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:45:37 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:45:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:37 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd 1073741824 Nov 06 18:45:37 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:38 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd 1073741824" returned: 0 in 0.777s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:38 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd Nov 06 18:45:38 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:38 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd" returned: 0 in 0.364s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:45:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:38 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Attempting download of 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}])) to volume 69842e92-0cdd-48c2-a98f-2ca2d89bc3dd. {{(pid=86794) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 18:45:38 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e03b2b-6d78-481f-b10d-ef4e440d1304]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_5ynjm_e8 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:38 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_5ynjm_e8 Nov 06 18:45:38 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:39 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_5ynjm_e8" returned: 0 in 0.546s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_5ynjm_e8 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:39 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_5ynjm_e8 Nov 06 18:45:39 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:40 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_5ynjm_e8" returned: 1 in 0.700s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_5ynjm_e8' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:45:40 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c92918-c536-4847-9e33-fd9171f5d332]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_1e5u_g6tdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:40 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_1e5u_g6tdevstack@QuobyteHD Nov 06 18:45:40 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:40 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_1e5u_g6tdevstack@QuobyteHD" returned: 0 in 0.534s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:40 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 was qcow2, converting to qcow2 {{(pid=86794) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 18:45:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_1e5u_g6tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4649f9d5-2ddf-4d1f-9a8a-fb1e0dcd0f47 tempest-VolumesListTestJSON-2052757374 None] Acquiring lock "cinder-0b03686b-f688-4a71-96a2-e83ab3ae0b68-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:40 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_1e5u_g6tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd Nov 06 18:45:40 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4649f9d5-2ddf-4d1f-9a8a-fb1e0dcd0f47 tempest-VolumesListTestJSON-2052757374 None] Lock "cinder-0b03686b-f688-4a71-96a2-e83ab3ae0b68-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4649f9d5-2ddf-4d1f-9a8a-fb1e0dcd0f47 tempest-VolumesListTestJSON-2052757374 None] Acquiring lock "cinder-quobyte-0b03686b-f688-4a71-96a2-e83ab3ae0b68" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4649f9d5-2ddf-4d1f-9a8a-fb1e0dcd0f47 tempest-VolumesListTestJSON-2052757374 None] Lock "cinder-quobyte-0b03686b-f688-4a71-96a2-e83ab3ae0b68" acquired by "delete_volume" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:40 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[b628b623-fad0-4556-9932-e58163d5cc1d]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4649f9d5-2ddf-4d1f-9a8a-fb1e0dcd0f47 tempest-VolumesListTestJSON-2052757374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0b03686b-f688-4a71-96a2-e83ab3ae0b68 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:40 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0b03686b-f688-4a71-96a2-e83ab3ae0b68 Nov 06 18:45:40 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:41 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4649f9d5-2ddf-4d1f-9a8a-fb1e0dcd0f47 tempest-VolumesListTestJSON-2052757374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0b03686b-f688-4a71-96a2-e83ab3ae0b68" returned: 0 in 0.515s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4649f9d5-2ddf-4d1f-9a8a-fb1e0dcd0f47 tempest-VolumesListTestJSON-2052757374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0b03686b-f688-4a71-96a2-e83ab3ae0b68 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:41 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0b03686b-f688-4a71-96a2-e83ab3ae0b68 Nov 06 18:45:41 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:41 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-f7cd8fe1-e6d7-4915-9879-386917cb012b req-99529417-076b-484c-8583-773295d135d8 tempest-TestInstancesWithCinderVolumes-1982719473 None] Terminate volume connection completed successfully. Nov 06 18:45:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-f7cd8fe1-e6d7-4915-9879-386917cb012b req-99529417-076b-484c-8583-773295d135d8 tempest-TestInstancesWithCinderVolumes-1982719473 None] Deleting attachment 8a3d841a-5ec9-4f9c-bbe0-f5098b9ebb96. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:45:41 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4649f9d5-2ddf-4d1f-9a8a-fb1e0dcd0f47 tempest-VolumesListTestJSON-2052757374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0b03686b-f688-4a71-96a2-e83ab3ae0b68" returned: 0 in 0.326s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4649f9d5-2ddf-4d1f-9a8a-fb1e0dcd0f47 tempest-VolumesListTestJSON-2052757374 None] Lock "cinder-quobyte-0b03686b-f688-4a71-96a2-e83ab3ae0b68" released by "delete_volume" :: held 0.892s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:41 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-4649f9d5-2ddf-4d1f-9a8a-fb1e0dcd0f47 tempest-VolumesListTestJSON-2052757374 None] Created reservations ['09a4f808-74d6-4f38-a669-1828e2981af2', '336331ef-56ec-4455-8170-3659d0f8c190', '95264076-c4ba-4546-96a0-6ef013bb6f11', '7a8eb4b9-60fd-4316-9abd-f923e6501448'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:45:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4649f9d5-2ddf-4d1f-9a8a-fb1e0dcd0f47 tempest-VolumesListTestJSON-2052757374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4649f9d5-2ddf-4d1f-9a8a-fb1e0dcd0f47 tempest-VolumesListTestJSON-2052757374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4649f9d5-2ddf-4d1f-9a8a-fb1e0dcd0f47 tempest-VolumesListTestJSON-2052757374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4649f9d5-2ddf-4d1f-9a8a-fb1e0dcd0f47 tempest-VolumesListTestJSON-2052757374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4649f9d5-2ddf-4d1f-9a8a-fb1e0dcd0f47 tempest-VolumesListTestJSON-2052757374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4649f9d5-2ddf-4d1f-9a8a-fb1e0dcd0f47 tempest-VolumesListTestJSON-2052757374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:41 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:45:41 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:42 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4649f9d5-2ddf-4d1f-9a8a-fb1e0dcd0f47 tempest-VolumesListTestJSON-2052757374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.302s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:42 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-4649f9d5-2ddf-4d1f-9a8a-fb1e0dcd0f47 tempest-VolumesListTestJSON-2052757374 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:45:42 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-4649f9d5-2ddf-4d1f-9a8a-fb1e0dcd0f47 tempest-VolumesListTestJSON-2052757374 None] Deleted volume successfully. Nov 06 18:45:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4649f9d5-2ddf-4d1f-9a8a-fb1e0dcd0f47 tempest-VolumesListTestJSON-2052757374 None] Lock "cinder-0b03686b-f688-4a71-96a2-e83ab3ae0b68-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] Acquiring lock "cinder-67b70858-8a68-4989-9091-783cd6163b93-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "cinder-67b70858-8a68-4989-9091-783cd6163b93-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] Acquiring lock "cinder-quobyte-67b70858-8a68-4989-9091-783cd6163b93" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "cinder-quobyte-67b70858-8a68-4989-9091-783cd6163b93" acquired by "delete_volume" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:42 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a225a79a-7cfa-4996-8adc-1b146c11dc99]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-67b70858-8a68-4989-9091-783cd6163b93 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:42 devstack sudo[101697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-67b70858-8a68-4989-9091-783cd6163b93 Nov 06 18:45:42 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fdadda0d-ca0a-4e5e-972f-8236a6e5f224 tempest-VolumesListTestJSON-2052757374 None] Acquiring lock "cinder-9cbc6781-5b08-487a-a794-defd937d8bbc-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fdadda0d-ca0a-4e5e-972f-8236a6e5f224 tempest-VolumesListTestJSON-2052757374 None] Lock "cinder-9cbc6781-5b08-487a-a794-defd937d8bbc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:43 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-67b70858-8a68-4989-9091-783cd6163b93" returned: 0 in 0.513s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-67b70858-8a68-4989-9091-783cd6163b93 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:43 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-67b70858-8a68-4989-9091-783cd6163b93 Nov 06 18:45:43 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fdadda0d-ca0a-4e5e-972f-8236a6e5f224 tempest-VolumesListTestJSON-2052757374 None] Acquiring lock "cinder-quobyte-9cbc6781-5b08-487a-a794-defd937d8bbc" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fdadda0d-ca0a-4e5e-972f-8236a6e5f224 tempest-VolumesListTestJSON-2052757374 None] Lock "cinder-quobyte-9cbc6781-5b08-487a-a794-defd937d8bbc" acquired by "delete_volume" :: waited 0.017s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:43 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac4a267-aa18-4458-aed3-4a0eedcd7892]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fdadda0d-ca0a-4e5e-972f-8236a6e5f224 tempest-VolumesListTestJSON-2052757374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9cbc6781-5b08-487a-a794-defd937d8bbc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_1e5u_g6tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd" returned: 0 in 2.576s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5fa2f633-f078-48b4-a3bb-6bfdd0d66033_1e5u_g6tdevstack@QuobyteHD, size 112.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:45:43 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Converted 112.00 MB image at 43.44 MB/s Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:43 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd 1G Nov 06 18:45:43 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:43 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9cbc6781-5b08-487a-a794-defd937d8bbc Nov 06 18:45:43 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:43 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-67b70858-8a68-4989-9091-783cd6163b93" returned: 0 in 0.315s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "cinder-quobyte-67b70858-8a68-4989-9091-783cd6163b93" released by "delete_volume" :: held 0.879s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:43 devstack cinder-volume[86794]: WARNING cinder.quota [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1819248717-1487628188 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1819248717-1487628188, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:45:43 devstack cinder-volume[86794]: WARNING cinder.quota [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1819248717-1487628188 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1819248717-1487628188, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] Created reservations ['f7e51ae4-5517-420d-9d91-527bcf9aff74', 'd9f863a4-9351-4fbc-ade1-1b4e71994e56', 'b8ac4876-7fc5-445c-b782-cb789c682ea1', '32e5e443-74d2-47af-90c8-f30c125566e8'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:43 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:43 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:45:43 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd 1G" returned: 0 in 0.441s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Downloaded image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}])) to volume 69842e92-0cdd-48c2-a98f-2ca2d89bc3dd successfully. {{(pid=86794) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Temporary image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 for user 77821379e8aa44f3b8f94376c7233786 is deleted. {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Marking volume 69842e92-0cdd-48c2-a98f-2ca2d89bc3dd as bootable. {{(pid=86794) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Copying metadata from image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 to 69842e92-0cdd-48c2-a98f-2ca2d89bc3dd. {{(pid=86794) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Creating volume glance metadata for volume 69842e92-0cdd-48c2-a98f-2ca2d89bc3dd backed by image 5fa2f633-f078-48b4-a3bb-6bfdd0d66033 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86794) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 18:45:43 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fdadda0d-ca0a-4e5e-972f-8236a6e5f224 tempest-VolumesListTestJSON-2052757374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9cbc6781-5b08-487a-a794-defd937d8bbc" returned: 0 in 0.501s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fdadda0d-ca0a-4e5e-972f-8236a6e5f224 tempest-VolumesListTestJSON-2052757374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9cbc6781-5b08-487a-a794-defd937d8bbc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:43 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9cbc6781-5b08-487a-a794-defd937d8bbc Nov 06 18:45:43 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e028e10-b361-4bb2-b891-b34b9678469f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd', 'volume_size': 1, 'image_id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d57c6da8e464b1a80cefabe6e3cfecd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fa2f633-f078-48b4-a3bb-6bfdd0d66033', 'created_at': datetime.datetime(2026, 11, 6, 17, 27, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 27, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fa2f633-f078-48b4-a3bb-6bfdd0d66033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e64714-f975-48af-80d7-3244cd8f1e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:43 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Volume volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd (69842e92-0cdd-48c2-a98f-2ca2d89bc3dd): created successfully Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e64714-f975-48af-80d7-3244cd8f1e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Flow 'volume_create_manager' (6646896a-7f51-4083-ad38-6a9b8b84e8f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:43 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-5e09fb51-a179-4be6-88db-fadfcb278f51 tempest-TestShelveInstance-493342226 None] Created volume successfully. Nov 06 18:45:43 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.379s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:43 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:45:43 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] Deleted volume successfully. Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-27ea8b3f-5f8a-4f14-918c-c885fe72b83a tempest-TestInstancesWithCinderVolumes-1982719473 None] Lock "cinder-67b70858-8a68-4989-9091-783cd6163b93-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:44 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fdadda0d-ca0a-4e5e-972f-8236a6e5f224 tempest-VolumesListTestJSON-2052757374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9cbc6781-5b08-487a-a794-defd937d8bbc" returned: 0 in 0.401s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fdadda0d-ca0a-4e5e-972f-8236a6e5f224 tempest-VolumesListTestJSON-2052757374 None] Lock "cinder-quobyte-9cbc6781-5b08-487a-a794-defd937d8bbc" released by "delete_volume" :: held 0.962s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Flow 'volume_create_manager' (b725e557-3a62-4bc0-9f4f-ca3b1ad2360d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e632261-0b15-445c-8bee-a6c1f5eaa97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e632261-0b15-445c-8bee-a6c1f5eaa97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-446595243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b2c6ad-fa22-4dd5-8255-bad30b3cfba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e474afd070741edb73a4027eb1f13af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:44Z,use_quota=True,user_id='ba777e8d62854f5aaced5cc4546d9c15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1d713a-35d0-4088-944e-90b8442a3c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1d713a-35d0-4088-944e-90b8442a3c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebc75ef-3944-4744-83b0-0d81d9bb85a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebc75ef-3944-4744-83b0-0d81d9bb85a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82b2c6ad-fa22-4dd5-8255-bad30b3cfba1', 'volume_name': 'volume-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fff12bd-e6b2-449e-9fe0-72631a10be23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fff12bd-e6b2-449e-9fe0-72631a10be23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1f68e89-abe7-490a-84be-ae6721ce21e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:44 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Volume 82b2c6ad-fa22-4dd5-8255-bad30b3cfba1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1', 'volume_size': 1} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-446595243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b2c6ad-fa22-4dd5-8255-bad30b3cfba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e474afd070741edb73a4027eb1f13af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:44Z,use_quota=True,user_id='ba777e8d62854f5aaced5cc4546d9c15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Creating volume 82b2c6ad-fa22-4dd5-8255-bad30b3cfba1 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:45:44 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:44 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1 1073741824 Nov 06 18:45:44 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-fdadda0d-ca0a-4e5e-972f-8236a6e5f224 tempest-VolumesListTestJSON-2052757374 None] Created reservations ['87c2db9c-3a56-498e-acdd-05c8cc91a514', '0e491b5e-6f02-4221-a120-04981767fa97', 'e1680b58-b22f-4ce8-8140-97bec28f3e56', 'b67c252f-4e76-4969-a710-9dc792aeba26'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fdadda0d-ca0a-4e5e-972f-8236a6e5f224 tempest-VolumesListTestJSON-2052757374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fdadda0d-ca0a-4e5e-972f-8236a6e5f224 tempest-VolumesListTestJSON-2052757374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fdadda0d-ca0a-4e5e-972f-8236a6e5f224 tempest-VolumesListTestJSON-2052757374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fdadda0d-ca0a-4e5e-972f-8236a6e5f224 tempest-VolumesListTestJSON-2052757374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fdadda0d-ca0a-4e5e-972f-8236a6e5f224 tempest-VolumesListTestJSON-2052757374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fdadda0d-ca0a-4e5e-972f-8236a6e5f224 tempest-VolumesListTestJSON-2052757374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:44 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:45:44 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:44 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fdadda0d-ca0a-4e5e-972f-8236a6e5f224 tempest-VolumesListTestJSON-2052757374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.286s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-fdadda0d-ca0a-4e5e-972f-8236a6e5f224 tempest-VolumesListTestJSON-2052757374 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:45:44 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-fdadda0d-ca0a-4e5e-972f-8236a6e5f224 tempest-VolumesListTestJSON-2052757374 None] Deleted volume successfully. Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fdadda0d-ca0a-4e5e-972f-8236a6e5f224 tempest-VolumesListTestJSON-2052757374 None] Lock "cinder-9cbc6781-5b08-487a-a794-defd937d8bbc-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:44 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1 1073741824" returned: 0 in 0.563s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:44 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1 Nov 06 18:45:44 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:45 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1" returned: 0 in 0.294s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:45 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:45:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1f68e89-abe7-490a-84be-ae6721ce21e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e144c98-b934-4aa6-b31c-0d4b81abd2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:45 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Volume volume-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1 (82b2c6ad-fa22-4dd5-8255-bad30b3cfba1): created successfully Nov 06 18:45:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e144c98-b934-4aa6-b31c-0d4b81abd2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Flow 'volume_create_manager' (b725e557-3a62-4bc0-9f4f-ca3b1ad2360d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:45 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-15486d98-4642-4266-87e1-701f6fbf90ac tempest-VolumesNegativeTest-709547541 None] Created volume successfully. Nov 06 18:45:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a307ecaf-7b8c-4ca1-a805-7ef266aca01a tempest-VolumesListTestJSON-2052757374 None] Acquiring lock "cinder-f8b23172-cf13-4072-82b2-66e095421866-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a307ecaf-7b8c-4ca1-a805-7ef266aca01a tempest-VolumesListTestJSON-2052757374 None] Lock "cinder-f8b23172-cf13-4072-82b2-66e095421866-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a307ecaf-7b8c-4ca1-a805-7ef266aca01a tempest-VolumesListTestJSON-2052757374 None] Acquiring lock "cinder-quobyte-f8b23172-cf13-4072-82b2-66e095421866" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:45:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a307ecaf-7b8c-4ca1-a805-7ef266aca01a tempest-VolumesListTestJSON-2052757374 None] Lock "cinder-quobyte-f8b23172-cf13-4072-82b2-66e095421866" acquired by "delete_volume" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:45:45 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4455ab-632f-4391-81ce-b0d462d01d8a]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a307ecaf-7b8c-4ca1-a805-7ef266aca01a tempest-VolumesListTestJSON-2052757374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f8b23172-cf13-4072-82b2-66e095421866 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:45 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f8b23172-cf13-4072-82b2-66e095421866 Nov 06 18:45:45 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:45 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a307ecaf-7b8c-4ca1-a805-7ef266aca01a tempest-VolumesListTestJSON-2052757374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f8b23172-cf13-4072-82b2-66e095421866" returned: 0 in 0.434s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a307ecaf-7b8c-4ca1-a805-7ef266aca01a tempest-VolumesListTestJSON-2052757374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f8b23172-cf13-4072-82b2-66e095421866 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:46 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f8b23172-cf13-4072-82b2-66e095421866 Nov 06 18:45:46 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:46 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a307ecaf-7b8c-4ca1-a805-7ef266aca01a tempest-VolumesListTestJSON-2052757374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f8b23172-cf13-4072-82b2-66e095421866" returned: 0 in 0.330s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:46 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a307ecaf-7b8c-4ca1-a805-7ef266aca01a tempest-VolumesListTestJSON-2052757374 None] Lock "cinder-quobyte-f8b23172-cf13-4072-82b2-66e095421866" released by "delete_volume" :: held 0.858s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:46 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-a307ecaf-7b8c-4ca1-a805-7ef266aca01a tempest-VolumesListTestJSON-2052757374 None] Created reservations ['8db9db7f-4eb5-4aab-a4de-bea00d8490b8', '77ecbcf3-d00b-46b5-a0ac-999fc55cb4a8', '029a8deb-1d68-4717-893b-1fc81efa1dde', '56c656e4-e65f-4cec-94cd-9d7a4c69d44f'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:45:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a307ecaf-7b8c-4ca1-a805-7ef266aca01a tempest-VolumesListTestJSON-2052757374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a307ecaf-7b8c-4ca1-a805-7ef266aca01a tempest-VolumesListTestJSON-2052757374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a307ecaf-7b8c-4ca1-a805-7ef266aca01a tempest-VolumesListTestJSON-2052757374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a307ecaf-7b8c-4ca1-a805-7ef266aca01a tempest-VolumesListTestJSON-2052757374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a307ecaf-7b8c-4ca1-a805-7ef266aca01a tempest-VolumesListTestJSON-2052757374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a307ecaf-7b8c-4ca1-a805-7ef266aca01a tempest-VolumesListTestJSON-2052757374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:46 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:45:46 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:46 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a307ecaf-7b8c-4ca1-a805-7ef266aca01a tempest-VolumesListTestJSON-2052757374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.350s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:46 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-a307ecaf-7b8c-4ca1-a805-7ef266aca01a tempest-VolumesListTestJSON-2052757374 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:45:46 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a307ecaf-7b8c-4ca1-a805-7ef266aca01a tempest-VolumesListTestJSON-2052757374 None] Deleted volume successfully. Nov 06 18:45:47 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a307ecaf-7b8c-4ca1-a805-7ef266aca01a tempest-VolumesListTestJSON-2052757374 None] Lock "cinder-f8b23172-cf13-4072-82b2-66e095421866-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:45:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-c741a760-4732-409e-8e88-3e4bcb90f5c3 req-77e7c54e-328b-4a85-8baa-a1b09b71d4b1 tempest-TestShelveInstance-493342226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-c741a760-4732-409e-8e88-3e4bcb90f5c3 req-77e7c54e-328b-4a85-8baa-a1b09b71d4b1 tempest-TestShelveInstance-493342226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-c741a760-4732-409e-8e88-3e4bcb90f5c3 req-77e7c54e-328b-4a85-8baa-a1b09b71d4b1 tempest-TestShelveInstance-493342226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-c741a760-4732-409e-8e88-3e4bcb90f5c3 req-77e7c54e-328b-4a85-8baa-a1b09b71d4b1 tempest-TestShelveInstance-493342226 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dff0f955-ebce-411f-9f5e-35a8a4302f51', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:45:48 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-c741a760-4732-409e-8e88-3e4bcb90f5c3 req-77e7c54e-328b-4a85-8baa-a1b09b71d4b1 tempest-TestShelveInstance-493342226 None] attachment_update completed successfully. Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Flow 'volume_create_manager' (f15ad96d-3503-4856-b5e0-e22d75708488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7ce87a-448d-4f91-ab43-1f2af52a7f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7ce87a-448d-4f91-ab43-1f2af52a7f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-851437327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ebe523c-190b-4d7a-b39b-28a63bfd1b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='442d4e44795f4485b6efee81715c96fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:52Z,use_quota=True,user_id='45eb56204bb94753b130fb09e04042f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c8b52c-7dd1-4565-8643-1327239eca5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c8b52c-7dd1-4565-8643-1327239eca5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f69fce5-12ef-4b2c-8e63-cd80d4d205f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f69fce5-12ef-4b2c-8e63-cd80d4d205f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ebe523c-190b-4d7a-b39b-28a63bfd1b93', 'volume_name': 'volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5132630d-9e34-4a17-ab29-92fe69564df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5132630d-9e34-4a17-ab29-92fe69564df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e21863a-2b3a-4596-83d7-e0ce2bc6f4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:52 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Volume 5ebe523c-190b-4d7a-b39b-28a63bfd1b93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93', 'volume_size': 1} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-851437327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ebe523c-190b-4d7a-b39b-28a63bfd1b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='442d4e44795f4485b6efee81715c96fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:45:52Z,use_quota=True,user_id='45eb56204bb94753b130fb09e04042f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Creating volume 5ebe523c-190b-4d7a-b39b-28a63bfd1b93 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:45:52 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:52 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93 1073741824 Nov 06 18:45:52 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:52 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93 1073741824" returned: 0 in 0.531s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:52 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93 Nov 06 18:45:52 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:53 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93" returned: 0 in 0.311s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:45:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e21863a-2b3a-4596-83d7-e0ce2bc6f4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0b985d-1bcb-4f43-a1b4-fec904764aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:45:53 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Volume volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93 (5ebe523c-190b-4d7a-b39b-28a63bfd1b93): created successfully Nov 06 18:45:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0b985d-1bcb-4f43-a1b4-fec904764aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:45:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Flow 'volume_create_manager' (f15ad96d-3503-4856-b5e0-e22d75708488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:45:53 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-6cc7dd01-4476-4ac1-b12d-b43aebc63e9d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Created volume successfully. Nov 06 18:45:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-52946b98-ff68-41d7-b482-b7e37093d76e tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:45:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-52946b98-ff68-41d7-b482-b7e37093d76e tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:45:55 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-52946b98-ff68-41d7-b482-b7e37093d76e tempest-CreateVolumesFromSnapshotTest-1912843854 None] Creating offline snapshot 01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7 of volume 5ebe523c-190b-4d7a-b39b-28a63bfd1b93 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:45:55 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7224fa5f-03f8-4acb-b63f-0e103119e8d3]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:45:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-52946b98-ff68-41d7-b482-b7e37093d76e tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:55 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93 Nov 06 18:45:55 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:56 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-52946b98-ff68-41d7-b482-b7e37093d76e tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93" returned: 0 in 1.022s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-52946b98-ff68-41d7-b482-b7e37093d76e tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:56 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7 1G Nov 06 18:45:56 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:57 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-52946b98-ff68-41d7-b482-b7e37093d76e tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7 1G" returned: 0 in 1.481s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-52946b98-ff68-41d7-b482-b7e37093d76e tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:57 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7 Nov 06 18:45:57 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:58 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-52946b98-ff68-41d7-b482-b7e37093d76e tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7" returned: 0 in 0.973s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:58 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-52946b98-ff68-41d7-b482-b7e37093d76e tempest-CreateVolumesFromSnapshotTest-1912843854 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7 is being set with open permissions: ugo+rw Nov 06 18:45:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-52946b98-ff68-41d7-b482-b7e37093d76e tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:58 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7 Nov 06 18:45:58 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:58 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-52946b98-ff68-41d7-b482-b7e37093d76e tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7" returned: 0 in 0.327s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-52946b98-ff68-41d7-b482-b7e37093d76e tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:58 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.info Nov 06 18:45:58 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:59 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-52946b98-ff68-41d7-b482-b7e37093d76e tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.info" returned: 0 in 0.326s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:59 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-52946b98-ff68-41d7-b482-b7e37093d76e tempest-CreateVolumesFromSnapshotTest-1912843854 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.info is being set with open permissions: ugo+rw Nov 06 18:45:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-52946b98-ff68-41d7-b482-b7e37093d76e tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:45:59 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.info Nov 06 18:45:59 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:45:59 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Nov 06 18:45:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-52946b98-ff68-41d7-b482-b7e37093d76e tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.info" returned: 0 in 0.377s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:45:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-52946b98-ff68-41d7-b482-b7e37093d76e tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.651s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:45:59 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:UPDATE=164,cinder:SELECT=126,cinder:INSERT=51,cinder:DELETE=14 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:45:59 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-52946b98-ff68-41d7-b482-b7e37093d76e tempest-CreateVolumesFromSnapshotTest-1912843854 None] Create snapshot completed successfully Nov 06 18:46:01 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:UPDATE=137,cinder:DELETE=12,cinder:SELECT=138,cinder:INSERT=42 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Flow 'volume_create_manager' (06277d8d-4604-4a91-842e-de16d342a83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f3a74b8-52a4-4eaf-852b-2ab5d85e6f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f3a74b8-52a4-4eaf-852b-2ab5d85e6f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1586198414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf6f2b34-2b97-473d-b2b0-4911ca6800f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='442d4e44795f4485b6efee81715c96fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:02Z,use_quota=True,user_id='45eb56204bb94753b130fb09e04042f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4029e826-b724-4e6e-a5ce-04faf92d2af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4029e826-b724-4e6e-a5ce-04faf92d2af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f825c113-78d2-4a87-8ee8-9dab07328138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f825c113-78d2-4a87-8ee8-9dab07328138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf6f2b34-2b97-473d-b2b0-4911ca6800f2', 'volume_name': 'volume-bf6f2b34-2b97-473d-b2b0-4911ca6800f2', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0d4e2a-4dd0-4d5e-a4e4-8f0b13c35923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0d4e2a-4dd0-4d5e-a4e4-8f0b13c35923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dcc5aa5-e3a7-43e4-ab10-de416c45c904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:02 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Volume bf6f2b34-2b97-473d-b2b0-4911ca6800f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf6f2b34-2b97-473d-b2b0-4911ca6800f2', 'volume_size': 1} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1586198414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf6f2b34-2b97-473d-b2b0-4911ca6800f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='442d4e44795f4485b6efee81715c96fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:02Z,use_quota=True,user_id='45eb56204bb94753b130fb09e04042f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Creating volume bf6f2b34-2b97-473d-b2b0-4911ca6800f2 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:46:02 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:46:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf6f2b34-2b97-473d-b2b0-4911ca6800f2 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:02 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf6f2b34-2b97-473d-b2b0-4911ca6800f2 1073741824 Nov 06 18:46:02 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:03 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:46:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Flow 'volume_create_manager' (3e2cf952-5e08-4ad4-adbc-81f0a40a2bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (176510f7-a6fa-43fa-a2fd-401ad2ddcb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (176510f7-a6fa-43fa-a2fd-401ad2ddcb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1949970012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='442d4e44795f4485b6efee81715c96fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:03Z,use_quota=True,user_id='45eb56204bb94753b130fb09e04042f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6f4886-0dec-450d-a1ea-9482aa8fc346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6f4886-0dec-450d-a1ea-9482aa8fc346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02eb79b0-bcb8-4bfc-b83a-0135429af76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02eb79b0-bcb8-4bfc-b83a-0135429af76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274', 'volume_name': 'volume-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a32ed2-2c02-4e7f-a060-bcb46c15a9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a32ed2-2c02-4e7f-a060-bcb46c15a9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c69af65a-0460-4592-9ce9-7dbfb0e7048e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:03 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Volume 2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274', 'volume_size': 1} Nov 06 18:46:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:03 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf6f2b34-2b97-473d-b2b0-4911ca6800f2 1073741824" returned: 0 in 1.195s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf6f2b34-2b97-473d-b2b0-4911ca6800f2 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:03 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf6f2b34-2b97-473d-b2b0-4911ca6800f2 Nov 06 18:46:03 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Flow 'volume_create_manager' (a6fbbeb8-7969-4d75-b662-8298a6a22933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:04 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582e7493-ac68-49e0-a61b-a36354b2780d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf6f2b34-2b97-473d-b2b0-4911ca6800f2" returned: 0 in 0.911s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] <== create_volume: return (2239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.242s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.058s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1949970012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='442d4e44795f4485b6efee81715c96fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:03Z,use_quota=True,user_id='45eb56204bb94753b130fb09e04042f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Creating volume 2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:46:04 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:04 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274 1073741824 Nov 06 18:46:04 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582e7493-ac68-49e0-a61b-a36354b2780d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-390463660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98cf3a0d-456c-445a-8680-4077bedb3c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='442d4e44795f4485b6efee81715c96fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:04Z,use_quota=True,user_id='45eb56204bb94753b130fb09e04042f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d727c3-aea1-4f2a-90b5-543760eafe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d727c3-aea1-4f2a-90b5-543760eafe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6594ce5-6355-4cc7-9606-a5ee07a1ba56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6594ce5-6355-4cc7-9606-a5ee07a1ba56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98cf3a0d-456c-445a-8680-4077bedb3c97', 'volume_name': 'volume-98cf3a0d-456c-445a-8680-4077bedb3c97', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e33edc14-a260-4b9d-a223-857f6aaa2667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e33edc14-a260-4b9d-a223-857f6aaa2667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e2dffa-719e-4d6c-a3e2-56c706d85e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:04 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Volume 98cf3a0d-456c-445a-8680-4077bedb3c97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98cf3a0d-456c-445a-8680-4077bedb3c97', 'volume_size': 1} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dcc5aa5-e3a7-43e4-ab10-de416c45c904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf6f2b34-2b97-473d-b2b0-4911ca6800f2', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (457d6924-2032-4ada-8719-902d3632d859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:04 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Volume volume-bf6f2b34-2b97-473d-b2b0-4911ca6800f2 (bf6f2b34-2b97-473d-b2b0-4911ca6800f2): created successfully Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (457d6924-2032-4ada-8719-902d3632d859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Flow 'volume_create_manager' (06277d8d-4604-4a91-842e-de16d342a83b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:04 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-69114d5b-19b4-4045-b0cb-5fb605565fb1 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Created volume successfully. Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Flow 'volume_create_manager' (663ba6cd-505d-4ac0-be15-b7a244e6428a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df54d3cd-fb3f-4d5e-973e-06f630ca0d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df54d3cd-fb3f-4d5e-973e-06f630ca0d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1664135177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4202a0b-2f6f-449f-aac9-e6084600890c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='442d4e44795f4485b6efee81715c96fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:05Z,use_quota=True,user_id='45eb56204bb94753b130fb09e04042f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d790a62e-a818-4c41-b304-bd131b3ad8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d790a62e-a818-4c41-b304-bd131b3ad8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847c305d-4c20-4bca-9db9-dcac3e5f92b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847c305d-4c20-4bca-9db9-dcac3e5f92b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4202a0b-2f6f-449f-aac9-e6084600890c', 'volume_name': 'volume-b4202a0b-2f6f-449f-aac9-e6084600890c', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1e6a09-8972-442d-8bd5-f6b62a46b56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1e6a09-8972-442d-8bd5-f6b62a46b56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f70d86b-d2c2-479b-8b63-d24e36db16ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:05 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Volume b4202a0b-2f6f-449f-aac9-e6084600890c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4202a0b-2f6f-449f-aac9-e6084600890c', 'volume_size': 1} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:05 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274 1073741824" returned: 0 in 0.983s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:05 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274 Nov 06 18:46:05 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:05 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274" returned: 0 in 0.443s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.314s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-390463660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98cf3a0d-456c-445a-8680-4077bedb3c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='442d4e44795f4485b6efee81715c96fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:04Z,use_quota=True,user_id='45eb56204bb94753b130fb09e04042f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Creating volume 98cf3a0d-456c-445a-8680-4077bedb3c97 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:46:05 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:46:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-98cf3a0d-456c-445a-8680-4077bedb3c97 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c69af65a-0460-4592-9ce9-7dbfb0e7048e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:06 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-98cf3a0d-456c-445a-8680-4077bedb3c97 1073741824 Nov 06 18:46:06 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5917a6b-f731-4dd7-933c-40853d2236fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:06 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:46:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Flow 'volume_create_manager' (86804f7c-dd18-465b-9a8c-73345d232533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b993394-af14-4270-8101-d7fad794f095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:06 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Volume volume-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274 (2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274): created successfully Nov 06 18:46:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5917a6b-f731-4dd7-933c-40853d2236fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Flow 'volume_create_manager' (3e2cf952-5e08-4ad4-adbc-81f0a40a2bad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b993394-af14-4270-8101-d7fad794f095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1476927548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f709d9c-1917-4390-8b3c-f141d59a56be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='442d4e44795f4485b6efee81715c96fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:06Z,use_quota=True,user_id='45eb56204bb94753b130fb09e04042f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d10d35b2-d491-4509-8ba8-12ed6b3578c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d10d35b2-d491-4509-8ba8-12ed6b3578c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f091f0-8239-41ab-951b-a75f6d80d631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f091f0-8239-41ab-951b-a75f6d80d631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f709d9c-1917-4390-8b3c-f141d59a56be', 'volume_name': 'volume-2f709d9c-1917-4390-8b3c-f141d59a56be', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dddb1c35-8757-42e6-bffc-44684e422ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dddb1c35-8757-42e6-bffc-44684e422ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185dce21-30c5-4ad4-83c7-fc11548d1251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:06 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Volume 2f709d9c-1917-4390-8b3c-f141d59a56be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f709d9c-1917-4390-8b3c-f141d59a56be', 'volume_size': 1} Nov 06 18:46:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:06 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-ca3adcb8-b7e8-408e-a674-088f2e26e1a4 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Created volume successfully. Nov 06 18:46:06 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-98cf3a0d-456c-445a-8680-4077bedb3c97 1073741824" returned: 0 in 0.795s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-98cf3a0d-456c-445a-8680-4077bedb3c97 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:06 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-98cf3a0d-456c-445a-8680-4077bedb3c97 Nov 06 18:46:06 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:07 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-98cf3a0d-456c-445a-8680-4077bedb3c97" returned: 0 in 0.478s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:46:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.035s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1664135177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4202a0b-2f6f-449f-aac9-e6084600890c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='442d4e44795f4485b6efee81715c96fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:05Z,use_quota=True,user_id='45eb56204bb94753b130fb09e04042f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:46:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Creating volume b4202a0b-2f6f-449f-aac9-e6084600890c {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:46:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:46:07 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:46:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b4202a0b-2f6f-449f-aac9-e6084600890c 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e2dffa-719e-4d6c-a3e2-56c706d85e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98cf3a0d-456c-445a-8680-4077bedb3c97', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:07 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b4202a0b-2f6f-449f-aac9-e6084600890c 1073741824 Nov 06 18:46:07 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d8ac0f6-75b3-42e2-976a-9c58481b5a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:07 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Volume volume-98cf3a0d-456c-445a-8680-4077bedb3c97 (98cf3a0d-456c-445a-8680-4077bedb3c97): created successfully Nov 06 18:46:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d8ac0f6-75b3-42e2-976a-9c58481b5a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Flow 'volume_create_manager' (a6fbbeb8-7969-4d75-b662-8298a6a22933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:07 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-cad9b4e7-93e7-4a26-bb12-127f947f77b9 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Created volume successfully. Nov 06 18:46:08 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b4202a0b-2f6f-449f-aac9-e6084600890c 1073741824" returned: 0 in 0.789s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b4202a0b-2f6f-449f-aac9-e6084600890c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:08 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b4202a0b-2f6f-449f-aac9-e6084600890c Nov 06 18:46:08 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:08 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b4202a0b-2f6f-449f-aac9-e6084600890c" returned: 0 in 0.429s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:46:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.332s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1476927548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f709d9c-1917-4390-8b3c-f141d59a56be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='442d4e44795f4485b6efee81715c96fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:06Z,use_quota=True,user_id='45eb56204bb94753b130fb09e04042f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:46:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Creating volume 2f709d9c-1917-4390-8b3c-f141d59a56be {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:46:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:08 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:46:08 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:46:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f709d9c-1917-4390-8b3c-f141d59a56be 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f70d86b-d2c2-479b-8b63-d24e36db16ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4202a0b-2f6f-449f-aac9-e6084600890c', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc5fb13-8b86-4cc0-91a9-ba06c0e26d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:08 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Volume volume-b4202a0b-2f6f-449f-aac9-e6084600890c (b4202a0b-2f6f-449f-aac9-e6084600890c): created successfully Nov 06 18:46:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc5fb13-8b86-4cc0-91a9-ba06c0e26d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:08 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f709d9c-1917-4390-8b3c-f141d59a56be 1073741824 Nov 06 18:46:08 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Flow 'volume_create_manager' (663ba6cd-505d-4ac0-be15-b7a244e6428a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:08 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-4f706d22-846b-45a5-a169-446d07a94883 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Created volume successfully. Nov 06 18:46:09 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f709d9c-1917-4390-8b3c-f141d59a56be 1073741824" returned: 0 in 0.779s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f709d9c-1917-4390-8b3c-f141d59a56be {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:09 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f709d9c-1917-4390-8b3c-f141d59a56be Nov 06 18:46:09 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:09 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f709d9c-1917-4390-8b3c-f141d59a56be" returned: 0 in 0.425s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:46:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185dce21-30c5-4ad4-83c7-fc11548d1251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f709d9c-1917-4390-8b3c-f141d59a56be', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e14fae-c171-484a-9159-299b76e774fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:09 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Volume volume-2f709d9c-1917-4390-8b3c-f141d59a56be (2f709d9c-1917-4390-8b3c-f141d59a56be): created successfully Nov 06 18:46:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e14fae-c171-484a-9159-299b76e774fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Flow 'volume_create_manager' (86804f7c-dd18-465b-9a8c-73345d232533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:09 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-35e46a34-b4e3-4486-8b87-b24cd4b6ddbc tempest-CreateVolumesFromSnapshotTest-1912843854 None] Created volume successfully. Nov 06 18:46:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4ebe8518-01c9-4c4b-ba92-d7aa9ac2e864 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "cinder-2f709d9c-1917-4390-8b3c-f141d59a56be-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4ebe8518-01c9-4c4b-ba92-d7aa9ac2e864 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-2f709d9c-1917-4390-8b3c-f141d59a56be-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4ebe8518-01c9-4c4b-ba92-d7aa9ac2e864 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "cinder-quobyte-2f709d9c-1917-4390-8b3c-f141d59a56be" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4ebe8518-01c9-4c4b-ba92-d7aa9ac2e864 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-quobyte-2f709d9c-1917-4390-8b3c-f141d59a56be" acquired by "delete_volume" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:10 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d60f50d-caa3-4a99-a700-93f928a69316]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:46:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4ebe8518-01c9-4c4b-ba92-d7aa9ac2e864 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f709d9c-1917-4390-8b3c-f141d59a56be {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:10 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f709d9c-1917-4390-8b3c-f141d59a56be Nov 06 18:46:10 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:11 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4ebe8518-01c9-4c4b-ba92-d7aa9ac2e864 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f709d9c-1917-4390-8b3c-f141d59a56be" returned: 0 in 0.528s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4ebe8518-01c9-4c4b-ba92-d7aa9ac2e864 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f709d9c-1917-4390-8b3c-f141d59a56be {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:11 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f709d9c-1917-4390-8b3c-f141d59a56be Nov 06 18:46:11 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:11 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4ebe8518-01c9-4c4b-ba92-d7aa9ac2e864 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f709d9c-1917-4390-8b3c-f141d59a56be" returned: 0 in 0.436s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:11 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4ebe8518-01c9-4c4b-ba92-d7aa9ac2e864 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-quobyte-2f709d9c-1917-4390-8b3c-f141d59a56be" released by "delete_volume" :: held 1.045s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:11 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-4ebe8518-01c9-4c4b-ba92-d7aa9ac2e864 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Created reservations ['4a1415df-3550-438b-92e0-e98e5bc2c624', '7fa5d18e-864c-4a65-a02e-0605ac89c5ec', '572afff8-c0b2-4748-af6c-c8676c361bff', 'bff8d149-207f-4f5d-bc9c-9660c0dcc95e'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:46:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4ebe8518-01c9-4c4b-ba92-d7aa9ac2e864 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4ebe8518-01c9-4c4b-ba92-d7aa9ac2e864 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4ebe8518-01c9-4c4b-ba92-d7aa9ac2e864 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4ebe8518-01c9-4c4b-ba92-d7aa9ac2e864 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4ebe8518-01c9-4c4b-ba92-d7aa9ac2e864 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4ebe8518-01c9-4c4b-ba92-d7aa9ac2e864 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:11 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:46:11 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:12 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4ebe8518-01c9-4c4b-ba92-d7aa9ac2e864 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.297s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:12 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-4ebe8518-01c9-4c4b-ba92-d7aa9ac2e864 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:46:12 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-4ebe8518-01c9-4c4b-ba92-d7aa9ac2e864 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Deleted volume successfully. Nov 06 18:46:12 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4ebe8518-01c9-4c4b-ba92-d7aa9ac2e864 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-2f709d9c-1917-4390-8b3c-f141d59a56be-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:12 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f90f02ec-7ca0-4e1c-a7ee-73b5a24306a2 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "cinder-b4202a0b-2f6f-449f-aac9-e6084600890c-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:12 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f90f02ec-7ca0-4e1c-a7ee-73b5a24306a2 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-b4202a0b-2f6f-449f-aac9-e6084600890c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f90f02ec-7ca0-4e1c-a7ee-73b5a24306a2 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "cinder-quobyte-b4202a0b-2f6f-449f-aac9-e6084600890c" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f90f02ec-7ca0-4e1c-a7ee-73b5a24306a2 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-quobyte-b4202a0b-2f6f-449f-aac9-e6084600890c" acquired by "delete_volume" :: waited 0.052s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:13 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbeea8b-290f-415b-9486-a0e2366c4a43]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:46:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f90f02ec-7ca0-4e1c-a7ee-73b5a24306a2 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b4202a0b-2f6f-449f-aac9-e6084600890c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:13 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b4202a0b-2f6f-449f-aac9-e6084600890c Nov 06 18:46:13 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:13 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f90f02ec-7ca0-4e1c-a7ee-73b5a24306a2 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b4202a0b-2f6f-449f-aac9-e6084600890c" returned: 0 in 0.451s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f90f02ec-7ca0-4e1c-a7ee-73b5a24306a2 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b4202a0b-2f6f-449f-aac9-e6084600890c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:13 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b4202a0b-2f6f-449f-aac9-e6084600890c Nov 06 18:46:13 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:13 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f90f02ec-7ca0-4e1c-a7ee-73b5a24306a2 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b4202a0b-2f6f-449f-aac9-e6084600890c" returned: 0 in 0.275s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f90f02ec-7ca0-4e1c-a7ee-73b5a24306a2 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-quobyte-b4202a0b-2f6f-449f-aac9-e6084600890c" released by "delete_volume" :: held 0.806s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:13 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-f90f02ec-7ca0-4e1c-a7ee-73b5a24306a2 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Created reservations ['96838929-beb6-4f31-b407-5ee6f9bd8647', '4b93b3fd-7aaa-419f-9ab8-7481f6d5c910', '73517edd-6320-4479-becb-c8ad26ea57e2', '43982b16-73fe-47d2-878a-4bb3739db112'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:46:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f90f02ec-7ca0-4e1c-a7ee-73b5a24306a2 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f90f02ec-7ca0-4e1c-a7ee-73b5a24306a2 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f90f02ec-7ca0-4e1c-a7ee-73b5a24306a2 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f90f02ec-7ca0-4e1c-a7ee-73b5a24306a2 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f90f02ec-7ca0-4e1c-a7ee-73b5a24306a2 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f90f02ec-7ca0-4e1c-a7ee-73b5a24306a2 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:14 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:46:14 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:14 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-189b5ebb-880b-4e4f-ac22-257931c0adba tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "cinder-98cf3a0d-456c-445a-8680-4077bedb3c97-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:14 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-189b5ebb-880b-4e4f-ac22-257931c0adba tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-98cf3a0d-456c-445a-8680-4077bedb3c97-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:14 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-189b5ebb-880b-4e4f-ac22-257931c0adba tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "cinder-quobyte-98cf3a0d-456c-445a-8680-4077bedb3c97" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:14 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-189b5ebb-880b-4e4f-ac22-257931c0adba tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-quobyte-98cf3a0d-456c-445a-8680-4077bedb3c97" acquired by "delete_volume" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:14 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d714045-4c1c-4ee2-b7c2-64daa1feea32]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:46:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-189b5ebb-880b-4e4f-ac22-257931c0adba tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-98cf3a0d-456c-445a-8680-4077bedb3c97 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:14 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f90f02ec-7ca0-4e1c-a7ee-73b5a24306a2 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.417s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:14 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-f90f02ec-7ca0-4e1c-a7ee-73b5a24306a2 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:46:14 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-f90f02ec-7ca0-4e1c-a7ee-73b5a24306a2 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Deleted volume successfully. Nov 06 18:46:14 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-98cf3a0d-456c-445a-8680-4077bedb3c97 Nov 06 18:46:14 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:14 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f90f02ec-7ca0-4e1c-a7ee-73b5a24306a2 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-b4202a0b-2f6f-449f-aac9-e6084600890c-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:15 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-189b5ebb-880b-4e4f-ac22-257931c0adba tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-98cf3a0d-456c-445a-8680-4077bedb3c97" returned: 0 in 0.669s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-189b5ebb-880b-4e4f-ac22-257931c0adba tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-98cf3a0d-456c-445a-8680-4077bedb3c97 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:15 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-98cf3a0d-456c-445a-8680-4077bedb3c97 Nov 06 18:46:15 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:15 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-189b5ebb-880b-4e4f-ac22-257931c0adba tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-98cf3a0d-456c-445a-8680-4077bedb3c97" returned: 0 in 0.423s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-189b5ebb-880b-4e4f-ac22-257931c0adba tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-quobyte-98cf3a0d-456c-445a-8680-4077bedb3c97" released by "delete_volume" :: held 1.173s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:15 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-189b5ebb-880b-4e4f-ac22-257931c0adba tempest-CreateVolumesFromSnapshotTest-1912843854 None] Created reservations ['ca6e5c0a-701e-455f-91d4-306cc69e608e', '4c21a1ad-1dda-4ba9-a829-fe3152685b4e', 'b49df0f3-30af-42dc-813e-9be81a52034e', 'a492bba6-25ba-4eb6-b82b-a9c2a0fd605e'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:46:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-189b5ebb-880b-4e4f-ac22-257931c0adba tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-189b5ebb-880b-4e4f-ac22-257931c0adba tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-189b5ebb-880b-4e4f-ac22-257931c0adba tempest-CreateVolumesFromSnapshotTest-1912843854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-189b5ebb-880b-4e4f-ac22-257931c0adba tempest-CreateVolumesFromSnapshotTest-1912843854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-189b5ebb-880b-4e4f-ac22-257931c0adba tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-189b5ebb-880b-4e4f-ac22-257931c0adba tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:15 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:46:15 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:16 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-189b5ebb-880b-4e4f-ac22-257931c0adba tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.359s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:16 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-189b5ebb-880b-4e4f-ac22-257931c0adba tempest-CreateVolumesFromSnapshotTest-1912843854 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:46:16 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-189b5ebb-880b-4e4f-ac22-257931c0adba tempest-CreateVolumesFromSnapshotTest-1912843854 None] Deleted volume successfully. Nov 06 18:46:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-189b5ebb-880b-4e4f-ac22-257931c0adba tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-98cf3a0d-456c-445a-8680-4077bedb3c97-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9897aaa2-6fa9-44d9-959f-964d8709f200 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "cinder-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9897aaa2-6fa9-44d9-959f-964d8709f200 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9897aaa2-6fa9-44d9-959f-964d8709f200 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "cinder-quobyte-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9897aaa2-6fa9-44d9-959f-964d8709f200 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-quobyte-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274" acquired by "delete_volume" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:16 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5e5602-857a-42cf-96c6-7efd9279f09e]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:46:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9897aaa2-6fa9-44d9-959f-964d8709f200 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a76ee12-9935-4702-a64c-cd20dba6ada9 tempest-VolumesNegativeTest-709547541 None] Acquiring lock "cinder-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a76ee12-9935-4702-a64c-cd20dba6ada9 tempest-VolumesNegativeTest-709547541 None] Lock "cinder-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a76ee12-9935-4702-a64c-cd20dba6ada9 tempest-VolumesNegativeTest-709547541 None] Acquiring lock "cinder-quobyte-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a76ee12-9935-4702-a64c-cd20dba6ada9 tempest-VolumesNegativeTest-709547541 None] Lock "cinder-quobyte-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1" acquired by "delete_volume" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:17 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[8158e738-cbbd-4373-a227-74e3a4df72b9]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:46:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a76ee12-9935-4702-a64c-cd20dba6ada9 tempest-VolumesNegativeTest-709547541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:17 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274 Nov 06 18:46:17 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:17 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1 Nov 06 18:46:17 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:17 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9897aaa2-6fa9-44d9-959f-964d8709f200 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274" returned: 0 in 0.545s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9897aaa2-6fa9-44d9-959f-964d8709f200 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:17 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274 Nov 06 18:46:17 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:17 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a76ee12-9935-4702-a64c-cd20dba6ada9 tempest-VolumesNegativeTest-709547541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1" returned: 0 in 0.478s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a76ee12-9935-4702-a64c-cd20dba6ada9 tempest-VolumesNegativeTest-709547541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:17 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1 Nov 06 18:46:17 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:17 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9897aaa2-6fa9-44d9-959f-964d8709f200 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274" returned: 0 in 0.366s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9897aaa2-6fa9-44d9-959f-964d8709f200 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-quobyte-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274" released by "delete_volume" :: held 0.979s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:17 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a76ee12-9935-4702-a64c-cd20dba6ada9 tempest-VolumesNegativeTest-709547541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1" returned: 0 in 0.321s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a76ee12-9935-4702-a64c-cd20dba6ada9 tempest-VolumesNegativeTest-709547541 None] Lock "cinder-quobyte-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1" released by "delete_volume" :: held 0.865s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:17 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-9897aaa2-6fa9-44d9-959f-964d8709f200 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Created reservations ['0a5461d7-b259-4341-8ad1-eff720502ba7', 'b436dcb1-7d34-47b0-8267-50f8cd0ba029', '58718c0f-6960-47b5-b2d9-a7e4e5a55d3d', 'e09991dd-4a93-4796-b6c8-8c6ce0e4ff25'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:46:17 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-6a76ee12-9935-4702-a64c-cd20dba6ada9 tempest-VolumesNegativeTest-709547541 None] Created reservations ['aed3549e-4a85-4fea-93fa-f46dcce5bc7b', 'bc1ffc0c-fcd1-4080-b3db-2ff885cd9030', '44cc57a1-e27f-4a7f-8521-ca1efd961984', '7f8999af-39f1-413b-9d4b-edcf31a3b909'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:46:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9897aaa2-6fa9-44d9-959f-964d8709f200 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9897aaa2-6fa9-44d9-959f-964d8709f200 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9897aaa2-6fa9-44d9-959f-964d8709f200 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9897aaa2-6fa9-44d9-959f-964d8709f200 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9897aaa2-6fa9-44d9-959f-964d8709f200 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9897aaa2-6fa9-44d9-959f-964d8709f200 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:18 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:46:18 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6a76ee12-9935-4702-a64c-cd20dba6ada9 tempest-VolumesNegativeTest-709547541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6a76ee12-9935-4702-a64c-cd20dba6ada9 tempest-VolumesNegativeTest-709547541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6a76ee12-9935-4702-a64c-cd20dba6ada9 tempest-VolumesNegativeTest-709547541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6a76ee12-9935-4702-a64c-cd20dba6ada9 tempest-VolumesNegativeTest-709547541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6a76ee12-9935-4702-a64c-cd20dba6ada9 tempest-VolumesNegativeTest-709547541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a76ee12-9935-4702-a64c-cd20dba6ada9 tempest-VolumesNegativeTest-709547541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:18 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:46:18 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:18 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9897aaa2-6fa9-44d9-959f-964d8709f200 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.398s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:18 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-9897aaa2-6fa9-44d9-959f-964d8709f200 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:46:18 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-9897aaa2-6fa9-44d9-959f-964d8709f200 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Deleted volume successfully. Nov 06 18:46:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9897aaa2-6fa9-44d9-959f-964d8709f200 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-2f5ded8a-126d-4e6c-a8d2-7dbbbfa67274-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:18 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6a76ee12-9935-4702-a64c-cd20dba6ada9 tempest-VolumesNegativeTest-709547541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.415s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:18 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-6a76ee12-9935-4702-a64c-cd20dba6ada9 tempest-VolumesNegativeTest-709547541 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:46:18 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-6a76ee12-9935-4702-a64c-cd20dba6ada9 tempest-VolumesNegativeTest-709547541 None] Deleted volume successfully. Nov 06 18:46:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6a76ee12-9935-4702-a64c-cd20dba6ada9 tempest-VolumesNegativeTest-709547541 None] Lock "cinder-82b2c6ad-fa22-4dd5-8255-bad30b3cfba1-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-18dbdbd8-c8d7-4599-8d3f-4a20e3b45a41 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "cinder-bf6f2b34-2b97-473d-b2b0-4911ca6800f2-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-18dbdbd8-c8d7-4599-8d3f-4a20e3b45a41 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-bf6f2b34-2b97-473d-b2b0-4911ca6800f2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-18dbdbd8-c8d7-4599-8d3f-4a20e3b45a41 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "cinder-quobyte-bf6f2b34-2b97-473d-b2b0-4911ca6800f2" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-18dbdbd8-c8d7-4599-8d3f-4a20e3b45a41 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-quobyte-bf6f2b34-2b97-473d-b2b0-4911ca6800f2" acquired by "delete_volume" :: waited 0.023s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:19 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bef4a49-0201-41b6-9223-1a3ebeda5679]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:46:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18dbdbd8-c8d7-4599-8d3f-4a20e3b45a41 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf6f2b34-2b97-473d-b2b0-4911ca6800f2 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:19 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf6f2b34-2b97-473d-b2b0-4911ca6800f2 Nov 06 18:46:19 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:19 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18dbdbd8-c8d7-4599-8d3f-4a20e3b45a41 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf6f2b34-2b97-473d-b2b0-4911ca6800f2" returned: 0 in 0.420s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18dbdbd8-c8d7-4599-8d3f-4a20e3b45a41 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf6f2b34-2b97-473d-b2b0-4911ca6800f2 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:19 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf6f2b34-2b97-473d-b2b0-4911ca6800f2 Nov 06 18:46:19 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:19 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18dbdbd8-c8d7-4599-8d3f-4a20e3b45a41 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf6f2b34-2b97-473d-b2b0-4911ca6800f2" returned: 0 in 0.320s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-18dbdbd8-c8d7-4599-8d3f-4a20e3b45a41 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-quobyte-bf6f2b34-2b97-473d-b2b0-4911ca6800f2" released by "delete_volume" :: held 0.800s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:19 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-18dbdbd8-c8d7-4599-8d3f-4a20e3b45a41 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Created reservations ['a6451707-fd0e-4fb0-9ecb-38d002e2d90b', '7ded4362-1903-4d9e-af5d-c6fcaf1c6d15', '7c4eb24f-4979-4f02-b2ca-cf3ecbda60c5', 'c825bc29-bcc7-4d19-9e4d-1289544d23ba'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-18dbdbd8-c8d7-4599-8d3f-4a20e3b45a41 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-18dbdbd8-c8d7-4599-8d3f-4a20e3b45a41 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-18dbdbd8-c8d7-4599-8d3f-4a20e3b45a41 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-18dbdbd8-c8d7-4599-8d3f-4a20e3b45a41 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-18dbdbd8-c8d7-4599-8d3f-4a20e3b45a41 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18dbdbd8-c8d7-4599-8d3f-4a20e3b45a41 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:20 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:46:20 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "cinder-01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "cinder-quobyte-5ebe523c-190b-4d7a-b39b-28a63bfd1b93" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-quobyte-5ebe523c-190b-4d7a-b39b-28a63bfd1b93" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "cinder-quobyte-01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-quobyte-01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Deleting offline snapshot 01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7 of volume 5ebe523c-190b-4d7a-b39b-28a63bfd1b93 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] snapshot_file for this snap is: volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[94103770-9bbc-4a8b-9cf7-89185b1d0bcd]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:20 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18dbdbd8-c8d7-4599-8d3f-4a20e3b45a41 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.336s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-18dbdbd8-c8d7-4599-8d3f-4a20e3b45a41 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:46:20 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-18dbdbd8-c8d7-4599-8d3f-4a20e3b45a41 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Deleted volume successfully. Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-18dbdbd8-c8d7-4599-8d3f-4a20e3b45a41 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-bf6f2b34-2b97-473d-b2b0-4911ca6800f2-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:20 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7 Nov 06 18:46:20 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:20 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7" returned: 0 in 0.503s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[88693b72-9f5c-422c-9a5b-5c1333e8fbde]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:46:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:20 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93 Nov 06 18:46:20 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:21 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93" returned: 0 in 0.431s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:21 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7 Nov 06 18:46:21 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:21 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7" returned: 0 in 0.425s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:21 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7 Nov 06 18:46:21 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:22 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93.01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7" returned: 0 in 0.286s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-quobyte-01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7" released by "_delete_snapshot" :: held 1.821s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-quobyte-5ebe523c-190b-4d7a-b39b-28a63bfd1b93" released by "delete_snapshot" :: held 1.856s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:22 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Created reservations ['4c0d2a7a-dd94-4b45-a272-95f67fd13349', '835039a0-9608-4de7-9fea-ec11f73c1d1c', 'e99056d9-f05c-4b50-bf90-e9a619a76b1b', 'ed929bc3-fef4-4ea4-95d2-32f5c433c258'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:46:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Delete snapshot completed successfully. Nov 06 18:46:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e2c13599-9f96-4b10-a365-79907c7ab683 tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-01e433b6-0dbc-44b2-b0dd-4ec9f09be9c7-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-75ecbb0a-7886-45c9-b10c-fe82cc8c364d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "cinder-5ebe523c-190b-4d7a-b39b-28a63bfd1b93-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-75ecbb0a-7886-45c9-b10c-fe82cc8c364d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-5ebe523c-190b-4d7a-b39b-28a63bfd1b93-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-75ecbb0a-7886-45c9-b10c-fe82cc8c364d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "cinder-quobyte-5ebe523c-190b-4d7a-b39b-28a63bfd1b93" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-75ecbb0a-7886-45c9-b10c-fe82cc8c364d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-quobyte-5ebe523c-190b-4d7a-b39b-28a63bfd1b93" acquired by "delete_volume" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:22 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2206e82-20df-4599-a29c-31a2b3d345f2]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:46:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75ecbb0a-7886-45c9-b10c-fe82cc8c364d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:22 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93 Nov 06 18:46:22 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:23 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75ecbb0a-7886-45c9-b10c-fe82cc8c364d tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93" returned: 0 in 0.422s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75ecbb0a-7886-45c9-b10c-fe82cc8c364d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:23 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93 Nov 06 18:46:23 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:23 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75ecbb0a-7886-45c9-b10c-fe82cc8c364d tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5ebe523c-190b-4d7a-b39b-28a63bfd1b93" returned: 0 in 0.340s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-75ecbb0a-7886-45c9-b10c-fe82cc8c364d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-quobyte-5ebe523c-190b-4d7a-b39b-28a63bfd1b93" released by "delete_volume" :: held 0.878s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:23 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-75ecbb0a-7886-45c9-b10c-fe82cc8c364d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Created reservations ['cfa146ac-4ff4-4d5e-b922-62567de6d62d', '205eee3a-eb3a-4633-890b-d1556a135ed5', 'bfe6ada8-63ae-415d-9c43-13f35e3b4a1b', '16b21293-c57f-4339-bd20-274175ed94d4'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:46:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-75ecbb0a-7886-45c9-b10c-fe82cc8c364d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-75ecbb0a-7886-45c9-b10c-fe82cc8c364d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-75ecbb0a-7886-45c9-b10c-fe82cc8c364d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-75ecbb0a-7886-45c9-b10c-fe82cc8c364d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-75ecbb0a-7886-45c9-b10c-fe82cc8c364d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75ecbb0a-7886-45c9-b10c-fe82cc8c364d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:23 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:46:23 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:24 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75ecbb0a-7886-45c9-b10c-fe82cc8c364d tempest-CreateVolumesFromSnapshotTest-1912843854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.469s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:24 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-75ecbb0a-7886-45c9-b10c-fe82cc8c364d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:46:24 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-75ecbb0a-7886-45c9-b10c-fe82cc8c364d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Deleted volume successfully. Nov 06 18:46:24 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-75ecbb0a-7886-45c9-b10c-fe82cc8c364d tempest-CreateVolumesFromSnapshotTest-1912843854 None] Lock "cinder-5ebe523c-190b-4d7a-b39b-28a63bfd1b93-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:46:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:29 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:46:29 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:29 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.512s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:46:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:46:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 29 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:46:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Flow 'volume_create_manager' (4b8bc201-b512-4189-a766-1b290bc6ca38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a41286f-2f8e-4bc3-b373-cf52c07d5ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a41286f-2f8e-4bc3-b373-cf52c07d5ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1788575296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3090cd91-1f7d-4d2a-beb9-fe87eefeb883,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf8524480f0422f9559ffbd10a38935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:31Z,use_quota=True,user_id='64b061aa85f14b87a34091021566fe47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3c5a9f-d523-4d66-951e-5bd828e57f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3c5a9f-d523-4d66-951e-5bd828e57f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f71902b-1774-4584-83c4-721bf74e363b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f71902b-1774-4584-83c4-721bf74e363b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3090cd91-1f7d-4d2a-beb9-fe87eefeb883', 'volume_name': 'volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562cb181-9491-4e35-ad11-254089ad6acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562cb181-9491-4e35-ad11-254089ad6acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a1198b-b5df-45e0-81ba-0de52c952bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:31 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Volume 3090cd91-1f7d-4d2a-beb9-fe87eefeb883: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883', 'volume_size': 1} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1788575296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3090cd91-1f7d-4d2a-beb9-fe87eefeb883,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf8524480f0422f9559ffbd10a38935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:31Z,use_quota=True,user_id='64b061aa85f14b87a34091021566fe47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Creating volume 3090cd91-1f7d-4d2a-beb9-fe87eefeb883 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:46:31 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:46:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:31 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 1073741824 Nov 06 18:46:31 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:32 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 1073741824" returned: 0 in 0.686s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:32 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 Nov 06 18:46:32 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:32 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883" returned: 0 in 0.302s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:32 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:46:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a1198b-b5df-45e0-81ba-0de52c952bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3762eb4e-9f6e-4017-b10c-8f2ce590d096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:32 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Volume volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 (3090cd91-1f7d-4d2a-beb9-fe87eefeb883): created successfully Nov 06 18:46:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3762eb4e-9f6e-4017-b10c-8f2ce590d096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Flow 'volume_create_manager' (4b8bc201-b512-4189-a766-1b290bc6ca38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:32 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-644bdf76-8096-4744-b974-5616976012ad tempest-VolumeDependencyTests-359295915 None] Created volume successfully. Nov 06 18:46:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c9284213-f90a-4ed2-91d5-990beaf3a94c tempest-VolumeDependencyTests-359295915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c9284213-f90a-4ed2-91d5-990beaf3a94c tempest-VolumeDependencyTests-359295915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-c9284213-f90a-4ed2-91d5-990beaf3a94c tempest-VolumeDependencyTests-359295915 None] Creating offline snapshot aa3facaa-2002-41e0-8dbe-09ca2c89ce1d of volume 3090cd91-1f7d-4d2a-beb9-fe87eefeb883 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:46:33 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e51927-8c41-41ff-89c7-ad80a163d621]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:46:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c9284213-f90a-4ed2-91d5-990beaf3a94c tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:34 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 Nov 06 18:46:34 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:34 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c9284213-f90a-4ed2-91d5-990beaf3a94c tempest-VolumeDependencyTests-359295915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883" returned: 0 in 0.642s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c9284213-f90a-4ed2-91d5-990beaf3a94c tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:34 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d 1G Nov 06 18:46:34 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:35 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:46:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Flow 'volume_create_manager' (8a8968b6-a2d1-4f5d-9949-926e80fb9e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aca8cf9-ea92-48f5-8277-7eb8406a2ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:35 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c9284213-f90a-4ed2-91d5-990beaf3a94c tempest-VolumeDependencyTests-359295915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d 1G" returned: 0 in 0.648s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c9284213-f90a-4ed2-91d5-990beaf3a94c tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aca8cf9-ea92-48f5-8277-7eb8406a2ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1349323416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d7effc2-867e-4ba1-b871-14c6452c1e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ffebc70c0e404c93d12da105c49fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:35Z,use_quota=True,user_id='3d18358a482348ef9d9cfeacdea41b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (474aa788-2aaf-45c7-affd-b725fabc8eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:35 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d Nov 06 18:46:35 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (474aa788-2aaf-45c7-affd-b725fabc8eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7ae1a2-10db-4621-bedd-e9c5bd866d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7ae1a2-10db-4621-bedd-e9c5bd866d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d7effc2-867e-4ba1-b871-14c6452c1e81', 'volume_name': 'volume-3d7effc2-867e-4ba1-b871-14c6452c1e81', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c19723e-9494-487f-854e-fedc75edefdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c19723e-9494-487f-854e-fedc75edefdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4ece2f-2bfb-4dd0-80bb-ea48754a4c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:35 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Volume 3d7effc2-867e-4ba1-b871-14c6452c1e81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d7effc2-867e-4ba1-b871-14c6452c1e81', 'volume_size': 1} Nov 06 18:46:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:35 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c9284213-f90a-4ed2-91d5-990beaf3a94c tempest-VolumeDependencyTests-359295915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d" returned: 0 in 0.383s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:35 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-c9284213-f90a-4ed2-91d5-990beaf3a94c tempest-VolumeDependencyTests-359295915 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d is being set with open permissions: ugo+rw Nov 06 18:46:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c9284213-f90a-4ed2-91d5-990beaf3a94c tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:35 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d Nov 06 18:46:35 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:35 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c9284213-f90a-4ed2-91d5-990beaf3a94c tempest-VolumeDependencyTests-359295915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d" returned: 0 in 0.374s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c9284213-f90a-4ed2-91d5-990beaf3a94c tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:36 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.info Nov 06 18:46:36 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:36 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c9284213-f90a-4ed2-91d5-990beaf3a94c tempest-VolumeDependencyTests-359295915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.info" returned: 0 in 0.339s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:36 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-c9284213-f90a-4ed2-91d5-990beaf3a94c tempest-VolumeDependencyTests-359295915 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.info is being set with open permissions: ugo+rw Nov 06 18:46:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c9284213-f90a-4ed2-91d5-990beaf3a94c tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:36 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.info Nov 06 18:46:36 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:36 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c9284213-f90a-4ed2-91d5-990beaf3a94c tempest-VolumeDependencyTests-359295915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.info" returned: 0 in 0.277s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c9284213-f90a-4ed2-91d5-990beaf3a94c tempest-VolumeDependencyTests-359295915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.865s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.414s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1349323416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d7effc2-867e-4ba1-b871-14c6452c1e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ffebc70c0e404c93d12da105c49fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:35Z,use_quota=True,user_id='3d18358a482348ef9d9cfeacdea41b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:46:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Creating volume 3d7effc2-867e-4ba1-b871-14c6452c1e81 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:46:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:46:36 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:46:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:36 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c9284213-f90a-4ed2-91d5-990beaf3a94c tempest-VolumeDependencyTests-359295915 None] Create snapshot completed successfully Nov 06 18:46:36 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81 1073741824 Nov 06 18:46:36 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:37 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81 1073741824" returned: 0 in 0.831s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:37 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81 Nov 06 18:46:37 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:46:38 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Flow 'volume_create_manager' (1f780537-6784-4ea5-ab76-91bc7a0a42ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea40763-4737-418b-b0f3-39d04261024c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81" returned: 0 in 0.811s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4ece2f-2bfb-4dd0-80bb-ea48754a4c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d7effc2-867e-4ba1-b871-14c6452c1e81', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28bb977c-fa76-4ea3-98d2-184c80324121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea40763-4737-418b-b0f3-39d04261024c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-283248903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18d7bcc-a334-4fd1-a938-ce6ddf3edb07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf8524480f0422f9559ffbd10a38935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aa3facaa-2002-41e0-8dbe-09ca2c89ce1d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:38Z,use_quota=True,user_id='64b061aa85f14b87a34091021566fe47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a55f64-cbd7-4e93-8fd2-77c6ce5bada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a55f64-cbd7-4e93-8fd2-77c6ce5bada5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7914fce2-945e-43ad-a9f2-5ab384c8b1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7914fce2-945e-43ad-a9f2-5ab384c8b1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f18d7bcc-a334-4fd1-a938-ce6ddf3edb07', 'volume_name': 'volume-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07', 'volume_size': 1, 'snapshot_id': 'aa3facaa-2002-41e0-8dbe-09ca2c89ce1d'}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba4b530-17d5-43ca-bf81-447d96579851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba4b530-17d5-43ca-bf81-447d96579851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a1dfa1-b742-4c8d-b498-cd2824c8626a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:38 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Volume f18d7bcc-a334-4fd1-a938-ce6ddf3edb07: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07', 'volume_size': 1, 'snapshot_id': 'aa3facaa-2002-41e0-8dbe-09ca2c89ce1d'} Nov 06 18:46:38 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Volume volume-3d7effc2-867e-4ba1-b871-14c6452c1e81 (3d7effc2-867e-4ba1-b871-14c6452c1e81): created successfully Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28bb977c-fa76-4ea3-98d2-184c80324121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Flow 'volume_create_manager' (8a8968b6-a2d1-4f5d-9949-926e80fb9e16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Acquiring lock "cinder-quobyte-aa3facaa-2002-41e0-8dbe-09ca2c89ce1d-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07" by "_create_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:38 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-bad7322d-7d6d-4650-b984-1c7671cd9f39 tempest-VolumesSnapshotTestJSON-988246926 None] Created volume successfully. Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Lock "cinder-quobyte-aa3facaa-2002-41e0-8dbe-09ca2c89ce1d-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Creating volume f18d7bcc-a334-4fd1-a938-ce6ddf3edb07 from snapshot aa3facaa-2002-41e0-8dbe-09ca2c89ce1d {{(pid=86794) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Acquiring lock "cinder-quobyte-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07" by "_copy_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Lock "cinder-quobyte-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] snapshot: aa3facaa-2002-41e0-8dbe-09ca2c89ce1d, volume: f18d7bcc-a334-4fd1-a938-ce6ddf3edb07, {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bd9a1c-fe38-437d-9856-f9d8dee6f04a]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:38 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d Nov 06 18:46:38 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:38 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-f68abcbf-0dcd-4595-8b25-a2178e7e6fa2 req-091f443e-b540-476d-a091-f24c6c1db37c tempest-TestShelveInstance-493342226 None] Terminate volume connection completed successfully. Nov 06 18:46:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-f68abcbf-0dcd-4595-8b25-a2178e7e6fa2 req-091f443e-b540-476d-a091-f24c6c1db37c tempest-TestShelveInstance-493342226 None] Deleting attachment dff0f955-ebce-411f-9f5e-35a8a4302f51. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:46:39 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d" returned: 0 in 0.636s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:46:39 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee3108c-db17-49b8-b4a9-cd09672cf9e9]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:46:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:39 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 Nov 06 18:46:39 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:39 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:46:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Flow 'volume_create_manager' (968d9c99-0bd7-4162-bc08-0b4ab50afba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c44bfc73-f08a-4d3f-966d-5d3a6abc7887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c44bfc73-f08a-4d3f-966d-5d3a6abc7887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-378187841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a2e8a54-a6cf-463c-88db-14b12a17bf4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800bbe8c210a46099236b2872447d32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:40Z,use_quota=True,user_id='7c0a5522417a4862839d37a80c17f46e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa9cead-bfc1-41d9-a2ba-9e21d9e1aae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa9cead-bfc1-41d9-a2ba-9e21d9e1aae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5099016-0a85-4851-b659-3a940511f48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5099016-0a85-4851-b659-3a940511f48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a2e8a54-a6cf-463c-88db-14b12a17bf4f', 'volume_name': 'volume-4a2e8a54-a6cf-463c-88db-14b12a17bf4f', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adaadd9a-58c0-4255-8325-39df3de4c5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adaadd9a-58c0-4255-8325-39df3de4c5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5546edd3-489e-48ce-940b-b0188196db1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:39 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Volume 4a2e8a54-a6cf-463c-88db-14b12a17bf4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a2e8a54-a6cf-463c-88db-14b12a17bf4f', 'volume_size': 1} Nov 06 18:46:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:40 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883" returned: 0 in 0.650s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 18:46:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Creating direct copy from snapshot {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 18:46:40 devstack cinder-volume[86794]: DEBUG cinder.utils [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Path /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07 not found in is_blk_device check {{(pid=86794) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 18:46:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:40 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07 Nov 06 18:46:40 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a2f263dd-694b-4068-b6e8-ec6cb5c15cfa tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:40 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:46:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Flow 'volume_create_manager' (68087f9b-3963-46f8-81ea-fe90f8f8774f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14412a46-68b5-48c0-8ceb-e7795e9beef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14412a46-68b5-48c0-8ceb-e7795e9beef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1884817719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24ad99e-2255-4a99-85a1-33e277c432af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800bbe8c210a46099236b2872447d32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:40Z,use_quota=True,user_id='7c0a5522417a4862839d37a80c17f46e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6468c2e9-d676-4800-b5ec-1b5c2ef0ca4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6468c2e9-d676-4800-b5ec-1b5c2ef0ca4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ccf43b-ada5-405c-8f4f-4bf5d3d2ad55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ccf43b-ada5-405c-8f4f-4bf5d3d2ad55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24ad99e-2255-4a99-85a1-33e277c432af', 'volume_name': 'volume-c24ad99e-2255-4a99-85a1-33e277c432af', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d799721-3046-4d00-906c-9f06f31c1bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d799721-3046-4d00-906c-9f06f31c1bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:40 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878d2756-0ca7-4a6a-8548-d2f76c1b2488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:40 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Volume c24ad99e-2255-4a99-85a1-33e277c432af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24ad99e-2255-4a99-85a1-33e277c432af', 'volume_size': 1} Nov 06 18:46:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-5e9b5638-fc24-43a0-bb53-98d4d83fcfe7 req-dd28c4ed-0fe5-4a95-8274-0b7943c2bf03 tempest-TestShelveInstance-493342226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:48 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07" returned: 0 in 8.305s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883, size 1024.00 MB, duration 8.31 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07 {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:46:48 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Converted 1024.00 MB image at 123.29 MB/s Nov 06 18:46:48 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07 is being set with open permissions: ugo+rw Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:48 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07 Nov 06 18:46:48 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:48 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07" returned: 0 in 0.283s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Lock "cinder-quobyte-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07" released by "_copy_volume_from_snapshot" :: held 10.050s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Lock "cinder-quobyte-aa3facaa-2002-41e0-8dbe-09ca2c89ce1d-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07" released by "_create_volume_from_snapshot" :: held 10.153s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.196s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.880s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-378187841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a2e8a54-a6cf-463c-88db-14b12a17bf4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800bbe8c210a46099236b2872447d32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:40Z,use_quota=True,user_id='7c0a5522417a4862839d37a80c17f46e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Creating volume 4a2e8a54-a6cf-463c-88db-14b12a17bf4f {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:46:48 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4a2e8a54-a6cf-463c-88db-14b12a17bf4f 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:48 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4a2e8a54-a6cf-463c-88db-14b12a17bf4f 1073741824 Nov 06 18:46:48 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a1dfa1-b742-4c8d-b498-cd2824c8626a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07', 'volume_size': 1, 'snapshot_id': 'aa3facaa-2002-41e0-8dbe-09ca2c89ce1d'}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44add049-e4fe-4831-8f09-137851ffeee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:48 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Volume volume-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07 (f18d7bcc-a334-4fd1-a938-ce6ddf3edb07): created successfully Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44add049-e4fe-4831-8f09-137851ffeee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Flow 'volume_create_manager' (1f780537-6784-4ea5-ab76-91bc7a0a42ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:48 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-b6ad88e3-b482-429a-bfb6-0dc6c2efe382 tempest-VolumeDependencyTests-359295915 None] Created volume successfully. Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] Acquiring lock "cinder-aa3facaa-2002-41e0-8dbe-09ca2c89ce1d-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] Lock "cinder-aa3facaa-2002-41e0-8dbe-09ca2c89ce1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] Acquiring lock "cinder-quobyte-3090cd91-1f7d-4d2a-beb9-fe87eefeb883" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] Lock "cinder-quobyte-3090cd91-1f7d-4d2a-beb9-fe87eefeb883" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] Acquiring lock "cinder-quobyte-aa3facaa-2002-41e0-8dbe-09ca2c89ce1d" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] Lock "cinder-quobyte-aa3facaa-2002-41e0-8dbe-09ca2c89ce1d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] Deleting offline snapshot aa3facaa-2002-41e0-8dbe-09ca2c89ce1d of volume 3090cd91-1f7d-4d2a-beb9-fe87eefeb883 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] snapshot_file for this snap is: volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb42ef1c-8b4b-49ce-86d1-edf2deab8ce8]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:49 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4a2e8a54-a6cf-463c-88db-14b12a17bf4f 1073741824" returned: 0 in 0.740s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4a2e8a54-a6cf-463c-88db-14b12a17bf4f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:49 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4a2e8a54-a6cf-463c-88db-14b12a17bf4f Nov 06 18:46:49 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:49 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d Nov 06 18:46:49 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:49 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4a2e8a54-a6cf-463c-88db-14b12a17bf4f" returned: 0 in 0.269s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a2f263dd-694b-4068-b6e8-ec6cb5c15cfa tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.500s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5546edd3-489e-48ce-940b-b0188196db1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a2e8a54-a6cf-463c-88db-14b12a17bf4f', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a6ab6b-3afc-4d85-bab7-accb49adce13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-a2f263dd-694b-4068-b6e8-ec6cb5c15cfa tempest-VolumesSnapshotTestJSON-988246926 None] Creating offline snapshot 256ab6e7-454f-49c9-9a53-ff9323aea81d of volume 3d7effc2-867e-4ba1-b871-14c6452c1e81 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:46:49 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Volume volume-4a2e8a54-a6cf-463c-88db-14b12a17bf4f (4a2e8a54-a6cf-463c-88db-14b12a17bf4f): created successfully Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a6ab6b-3afc-4d85-bab7-accb49adce13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Flow 'volume_create_manager' (968d9c99-0bd7-4162-bc08-0b4ab50afba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:49 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d16fab0-f5f5-4966-8128-1c65484d3c8a]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2f263dd-694b-4068-b6e8-ec6cb5c15cfa tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d" returned: 0 in 0.497s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce179d11-8d07-432c-a317-3c0185130a9e]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:46:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:49 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-eb1f2acd-17be-4ae3-b205-e9f2307d5883 tempest-TestServerVolumeAttachmentScenario-75865889 None] Created volume successfully. Nov 06 18:46:50 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81 Nov 06 18:46:50 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:50 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 Nov 06 18:46:50 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:50 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2f263dd-694b-4068-b6e8-ec6cb5c15cfa tempest-VolumesSnapshotTestJSON-988246926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81" returned: 0 in 0.477s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2f263dd-694b-4068-b6e8-ec6cb5c15cfa tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.256ab6e7-454f-49c9-9a53-ff9323aea81d 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:50 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.256ab6e7-454f-49c9-9a53-ff9323aea81d 1G Nov 06 18:46:50 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:50 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883" returned: 0 in 0.621s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:50 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d Nov 06 18:46:50 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:50 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2f263dd-694b-4068-b6e8-ec6cb5c15cfa tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.256ab6e7-454f-49c9-9a53-ff9323aea81d 1G" returned: 0 in 0.477s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2f263dd-694b-4068-b6e8-ec6cb5c15cfa tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d7effc2-867e-4ba1-b871-14c6452c1e81 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.256ab6e7-454f-49c9-9a53-ff9323aea81d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:50 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d7effc2-867e-4ba1-b871-14c6452c1e81 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.256ab6e7-454f-49c9-9a53-ff9323aea81d Nov 06 18:46:50 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:50 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d" returned: 0 in 0.423s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:51 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d Nov 06 18:46:51 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:51 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2f263dd-694b-4068-b6e8-ec6cb5c15cfa tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d7effc2-867e-4ba1-b871-14c6452c1e81 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.256ab6e7-454f-49c9-9a53-ff9323aea81d" returned: 0 in 0.336s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:51 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-a2f263dd-694b-4068-b6e8-ec6cb5c15cfa tempest-VolumesSnapshotTestJSON-988246926 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.256ab6e7-454f-49c9-9a53-ff9323aea81d is being set with open permissions: ugo+rw Nov 06 18:46:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2f263dd-694b-4068-b6e8-ec6cb5c15cfa tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.256ab6e7-454f-49c9-9a53-ff9323aea81d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:51 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.256ab6e7-454f-49c9-9a53-ff9323aea81d Nov 06 18:46:51 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:51 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883.aa3facaa-2002-41e0-8dbe-09ca2c89ce1d" returned: 0 in 0.280s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:51 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] Lock "cinder-quobyte-aa3facaa-2002-41e0-8dbe-09ca2c89ce1d" released by "_delete_snapshot" :: held 2.046s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:51 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] Lock "cinder-quobyte-3090cd91-1f7d-4d2a-beb9-fe87eefeb883" released by "delete_snapshot" :: held 2.080s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:51 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] Created reservations ['841cec61-631d-4c28-9417-09a709b276ae', 'ef357ab9-2083-42e3-86d4-635146eb5c39', '02493124-4d71-43c1-b85d-0bc27cd1d913', '6b92ea23-7e13-4e9d-8ebe-cfcbadad350b'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:46:51 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2f263dd-694b-4068-b6e8-ec6cb5c15cfa tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.256ab6e7-454f-49c9-9a53-ff9323aea81d" returned: 0 in 0.463s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2f263dd-694b-4068-b6e8-ec6cb5c15cfa tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:51 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.info Nov 06 18:46:51 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:51 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] Delete snapshot completed successfully. Nov 06 18:46:51 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2b41c71f-ef13-4a30-9db5-84559387bb80 tempest-VolumeDependencyTests-359295915 None] Lock "cinder-aa3facaa-2002-41e0-8dbe-09ca2c89ce1d-delete_snapshot" released by "delete_snapshot" :: held 2.589s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:52 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2f263dd-694b-4068-b6e8-ec6cb5c15cfa tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.info" returned: 0 in 0.455s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:52 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-a2f263dd-694b-4068-b6e8-ec6cb5c15cfa tempest-VolumesSnapshotTestJSON-988246926 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.info is being set with open permissions: ugo+rw Nov 06 18:46:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2f263dd-694b-4068-b6e8-ec6cb5c15cfa tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:52 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.info Nov 06 18:46:52 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7dd43f25-1b4f-468a-8fa5-05f34ce94216 tempest-VolumeDependencyTests-359295915 None] Acquiring lock "cinder-3090cd91-1f7d-4d2a-beb9-fe87eefeb883-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7dd43f25-1b4f-468a-8fa5-05f34ce94216 tempest-VolumeDependencyTests-359295915 None] Lock "cinder-3090cd91-1f7d-4d2a-beb9-fe87eefeb883-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7dd43f25-1b4f-468a-8fa5-05f34ce94216 tempest-VolumeDependencyTests-359295915 None] Acquiring lock "cinder-quobyte-3090cd91-1f7d-4d2a-beb9-fe87eefeb883" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7dd43f25-1b4f-468a-8fa5-05f34ce94216 tempest-VolumeDependencyTests-359295915 None] Lock "cinder-quobyte-3090cd91-1f7d-4d2a-beb9-fe87eefeb883" acquired by "delete_volume" :: waited 0.029s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:52 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2f263dd-694b-4068-b6e8-ec6cb5c15cfa tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.info" returned: 0 in 0.540s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a2f263dd-694b-4068-b6e8-ec6cb5c15cfa tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.964s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:52 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[3136b17f-18b5-4885-a888-e2e597e0d36a]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:46:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.177s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1884817719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24ad99e-2255-4a99-85a1-33e277c432af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800bbe8c210a46099236b2872447d32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:40Z,use_quota=True,user_id='7c0a5522417a4862839d37a80c17f46e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:46:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Creating volume c24ad99e-2255-4a99-85a1-33e277c432af {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:46:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:46:52 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:46:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c24ad99e-2255-4a99-85a1-33e277c432af 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7dd43f25-1b4f-468a-8fa5-05f34ce94216 tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:52 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c24ad99e-2255-4a99-85a1-33e277c432af 1073741824 Nov 06 18:46:52 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:52 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a2f263dd-694b-4068-b6e8-ec6cb5c15cfa tempest-VolumesSnapshotTestJSON-988246926 None] Create snapshot completed successfully Nov 06 18:46:52 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 Nov 06 18:46:52 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:53 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7dd43f25-1b4f-468a-8fa5-05f34ce94216 tempest-VolumeDependencyTests-359295915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883" returned: 0 in 0.563s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7dd43f25-1b4f-468a-8fa5-05f34ce94216 tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:53 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883 Nov 06 18:46:53 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:53 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c24ad99e-2255-4a99-85a1-33e277c432af 1073741824" returned: 0 in 0.977s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c24ad99e-2255-4a99-85a1-33e277c432af {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:53 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c24ad99e-2255-4a99-85a1-33e277c432af Nov 06 18:46:53 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:53 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7dd43f25-1b4f-468a-8fa5-05f34ce94216 tempest-VolumeDependencyTests-359295915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3090cd91-1f7d-4d2a-beb9-fe87eefeb883" returned: 0 in 0.517s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:53 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7dd43f25-1b4f-468a-8fa5-05f34ce94216 tempest-VolumeDependencyTests-359295915 None] Lock "cinder-quobyte-3090cd91-1f7d-4d2a-beb9-fe87eefeb883" released by "delete_volume" :: held 1.259s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-7dd43f25-1b4f-468a-8fa5-05f34ce94216 tempest-VolumeDependencyTests-359295915 None] Created reservations ['9324a45f-0e0d-420f-a987-1cdfced862c1', '728618cf-4d4a-4f58-aa16-a05aeabb962c', '1f62da72-a29b-4688-9720-1bccfd9d7d29', '467c97fa-3e19-4315-bd86-670a7429e20b'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7dd43f25-1b4f-468a-8fa5-05f34ce94216 tempest-VolumeDependencyTests-359295915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7dd43f25-1b4f-468a-8fa5-05f34ce94216 tempest-VolumeDependencyTests-359295915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7dd43f25-1b4f-468a-8fa5-05f34ce94216 tempest-VolumeDependencyTests-359295915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7dd43f25-1b4f-468a-8fa5-05f34ce94216 tempest-VolumeDependencyTests-359295915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7dd43f25-1b4f-468a-8fa5-05f34ce94216 tempest-VolumeDependencyTests-359295915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7dd43f25-1b4f-468a-8fa5-05f34ce94216 tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:54 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:46:54 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:54 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-256ab6e7-454f-49c9-9a53-ff9323aea81d-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c24ad99e-2255-4a99-85a1-33e277c432af" returned: 0 in 0.367s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-5e9b5638-fc24-43a0-bb53-98d4d83fcfe7 req-dd28c4ed-0fe5-4a95-8274-0b7943c2bf03 tempest-TestShelveInstance-493342226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.273s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878d2756-0ca7-4a6a-8548-d2f76c1b2488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24ad99e-2255-4a99-85a1-33e277c432af', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe38353-74cf-4552-8cf9-7ad0fca0f009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-256ab6e7-454f-49c9-9a53-ff9323aea81d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-5e9b5638-fc24-43a0-bb53-98d4d83fcfe7 req-dd28c4ed-0fe5-4a95-8274-0b7943c2bf03 tempest-TestShelveInstance-493342226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:54 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Volume volume-c24ad99e-2255-4a99-85a1-33e277c432af (c24ad99e-2255-4a99-85a1-33e277c432af): created successfully Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe38353-74cf-4552-8cf9-7ad0fca0f009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Flow 'volume_create_manager' (68087f9b-3963-46f8-81ea-fe90f8f8774f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:54 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c4a7ccb4-8daa-41ed-9185-afd82e3b7f50 tempest-TestServerVolumeAttachmentScenario-75865889 None] Created volume successfully. Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-5e9b5638-fc24-43a0-bb53-98d4d83fcfe7 req-dd28c4ed-0fe5-4a95-8274-0b7943c2bf03 tempest-TestShelveInstance-493342226 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74d10f88-22d4-4d26-9e85-6c950dcbdafa', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-quobyte-3d7effc2-867e-4ba1-b871-14c6452c1e81" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-3d7effc2-867e-4ba1-b871-14c6452c1e81" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-quobyte-256ab6e7-454f-49c9-9a53-ff9323aea81d" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-256ab6e7-454f-49c9-9a53-ff9323aea81d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] Deleting offline snapshot 256ab6e7-454f-49c9-9a53-ff9323aea81d of volume 3d7effc2-867e-4ba1-b871-14c6452c1e81 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] snapshot_file for this snap is: volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.256ab6e7-454f-49c9-9a53-ff9323aea81d {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a4628a-31c4-4f5f-90ee-385bb588f293]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.256ab6e7-454f-49c9-9a53-ff9323aea81d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:54 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7dd43f25-1b4f-468a-8fa5-05f34ce94216 tempest-VolumeDependencyTests-359295915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.344s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-7dd43f25-1b4f-468a-8fa5-05f34ce94216 tempest-VolumeDependencyTests-359295915 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:46:54 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-7dd43f25-1b4f-468a-8fa5-05f34ce94216 tempest-VolumeDependencyTests-359295915 None] Deleted volume successfully. Nov 06 18:46:54 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-5e9b5638-fc24-43a0-bb53-98d4d83fcfe7 req-dd28c4ed-0fe5-4a95-8274-0b7943c2bf03 tempest-TestShelveInstance-493342226 None] attachment_update completed successfully. Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7dd43f25-1b4f-468a-8fa5-05f34ce94216 tempest-VolumeDependencyTests-359295915 None] Lock "cinder-3090cd91-1f7d-4d2a-beb9-fe87eefeb883-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:54 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.256ab6e7-454f-49c9-9a53-ff9323aea81d Nov 06 18:46:54 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-92893613-1d91-474a-9f14-872e4b00582c tempest-VolumeDependencyTests-359295915 None] Acquiring lock "cinder-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:55 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-92893613-1d91-474a-9f14-872e4b00582c tempest-VolumeDependencyTests-359295915 None] Lock "cinder-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:55 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-92893613-1d91-474a-9f14-872e4b00582c tempest-VolumeDependencyTests-359295915 None] Acquiring lock "cinder-quobyte-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:46:55 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-92893613-1d91-474a-9f14-872e4b00582c tempest-VolumeDependencyTests-359295915 None] Lock "cinder-quobyte-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07" acquired by "delete_volume" :: waited 0.045s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:46:55 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4f4b78-4d7f-4b0c-9172-1fd9eda3efe1]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:46:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-92893613-1d91-474a-9f14-872e4b00582c tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:55 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.256ab6e7-454f-49c9-9a53-ff9323aea81d" returned: 0 in 0.827s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:55 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d7effc2-867e-4ba1-b871-14c6452c1e81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:46:55 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2dbd628-ec67-4002-b688-936dcd6453a8]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:46:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:55 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07 Nov 06 18:46:55 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:55 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81 Nov 06 18:46:55 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:55 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:55 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81" returned: 0 in 0.466s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.256ab6e7-454f-49c9-9a53-ff9323aea81d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-92893613-1d91-474a-9f14-872e4b00582c tempest-VolumeDependencyTests-359295915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07" returned: 0 in 0.601s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-92893613-1d91-474a-9f14-872e4b00582c tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:55 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.256ab6e7-454f-49c9-9a53-ff9323aea81d Nov 06 18:46:55 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:55 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07 Nov 06 18:46:55 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:56 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.256ab6e7-454f-49c9-9a53-ff9323aea81d" returned: 0 in 0.645s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.256ab6e7-454f-49c9-9a53-ff9323aea81d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:56 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-92893613-1d91-474a-9f14-872e4b00582c tempest-VolumeDependencyTests-359295915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07" returned: 0 in 0.648s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:56 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-92893613-1d91-474a-9f14-872e4b00582c tempest-VolumeDependencyTests-359295915 None] Lock "cinder-quobyte-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07" released by "delete_volume" :: held 1.354s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:56 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.256ab6e7-454f-49c9-9a53-ff9323aea81d Nov 06 18:46:56 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:56 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-92893613-1d91-474a-9f14-872e4b00582c tempest-VolumeDependencyTests-359295915 None] Created reservations ['cff018e0-2d8a-4ea0-a457-610a8acb85d9', '156650da-2fe0-499c-8ee3-35b52d96a3d1', '7c0c3e6f-01a9-4243-bd5a-d7d5274f41da', '912b3029-af8e-414b-922c-1c5067099aaf'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:46:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-92893613-1d91-474a-9f14-872e4b00582c tempest-VolumeDependencyTests-359295915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-92893613-1d91-474a-9f14-872e4b00582c tempest-VolumeDependencyTests-359295915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:56 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-92893613-1d91-474a-9f14-872e4b00582c tempest-VolumeDependencyTests-359295915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:56 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-92893613-1d91-474a-9f14-872e4b00582c tempest-VolumeDependencyTests-359295915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-92893613-1d91-474a-9f14-872e4b00582c tempest-VolumeDependencyTests-359295915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-92893613-1d91-474a-9f14-872e4b00582c tempest-VolumeDependencyTests-359295915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:56 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:46:56 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:56 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81.256ab6e7-454f-49c9-9a53-ff9323aea81d" returned: 0 in 0.511s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:57 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-256ab6e7-454f-49c9-9a53-ff9323aea81d" released by "_delete_snapshot" :: held 2.674s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:57 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-3d7effc2-867e-4ba1-b871-14c6452c1e81" released by "delete_snapshot" :: held 2.711s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:57 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-92893613-1d91-474a-9f14-872e4b00582c tempest-VolumeDependencyTests-359295915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.416s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:57 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-92893613-1d91-474a-9f14-872e4b00582c tempest-VolumeDependencyTests-359295915 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:46:57 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-92893613-1d91-474a-9f14-872e4b00582c tempest-VolumeDependencyTests-359295915 None] Deleted volume successfully. Nov 06 18:46:57 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-92893613-1d91-474a-9f14-872e4b00582c tempest-VolumeDependencyTests-359295915 None] Lock "cinder-f18d7bcc-a334-4fd1-a938-ce6ddf3edb07-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:57 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] Created reservations ['294964dd-fc33-4e3d-8ffa-33f69fb02daf', 'c8c0f9fc-bcdb-4a17-8598-393653978f94', 'ba34f9ff-3ff7-4e25-af8b-940b9d52a965', '63fb196d-8993-4cd2-9e35-3dc06011b038'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:46:57 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] Delete snapshot completed successfully. Nov 06 18:46:57 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2f3d4ea3-8137-4b65-b094-b97341bf47f0 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-256ab6e7-454f-49c9-9a53-ff9323aea81d-delete_snapshot" released by "delete_snapshot" :: held 3.060s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Flow 'volume_create_manager' (2f9d5bee-690f-417f-bd67-5433fc27af15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135b026a-291f-4977-8ea8-8250ff9116d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135b026a-291f-4977-8ea8-8250ff9116d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-167669919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04545bbc-42bd-4b87-993d-2e700b2dd385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ffebc70c0e404c93d12da105c49fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:58Z,use_quota=True,user_id='3d18358a482348ef9d9cfeacdea41b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09fd1eea-4e49-4a19-b00d-af11a48e10a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09fd1eea-4e49-4a19-b00d-af11a48e10a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a99e51a-1fae-499f-9c1c-c0163756d044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a99e51a-1fae-499f-9c1c-c0163756d044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04545bbc-42bd-4b87-993d-2e700b2dd385', 'volume_name': 'volume-04545bbc-42bd-4b87-993d-2e700b2dd385', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3fce98-26c0-445f-b604-d0420abbe649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3fce98-26c0-445f-b604-d0420abbe649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c308ace-e560-4693-8244-ad6b789bcb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:46:58 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Volume 04545bbc-42bd-4b87-993d-2e700b2dd385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04545bbc-42bd-4b87-993d-2e700b2dd385', 'volume_size': 1} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-167669919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04545bbc-42bd-4b87-993d-2e700b2dd385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ffebc70c0e404c93d12da105c49fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:46:58Z,use_quota=True,user_id='3d18358a482348ef9d9cfeacdea41b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Creating volume 04545bbc-42bd-4b87-993d-2e700b2dd385 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:46:58 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:46:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:58 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385 1073741824 Nov 06 18:46:58 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:46:59 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Nov 06 18:46:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385 1073741824" returned: 0 in 0.899s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:46:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:46:59 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385 Nov 06 18:46:59 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:00 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385" returned: 0 in 0.607s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:47:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:00 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=103,cinder:UPDATE=129,cinder:INSERT=30,cinder:DELETE=12 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:47:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c308ace-e560-4693-8244-ad6b789bcb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04545bbc-42bd-4b87-993d-2e700b2dd385', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7152089f-5083-4d4a-92ce-a050dc12cdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:00 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Volume volume-04545bbc-42bd-4b87-993d-2e700b2dd385 (04545bbc-42bd-4b87-993d-2e700b2dd385): created successfully Nov 06 18:47:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7152089f-5083-4d4a-92ce-a050dc12cdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Flow 'volume_create_manager' (2f9d5bee-690f-417f-bd67-5433fc27af15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:47:00 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-db790721-7b60-418d-acc4-6bb54cfd1649 tempest-VolumesSnapshotTestJSON-988246926 None] Created volume successfully. Nov 06 18:47:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-86331309-7596-47ac-ac3f-53798327cf58 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-86331309-7596-47ac-ac3f-53798327cf58 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-86331309-7596-47ac-ac3f-53798327cf58 tempest-VolumesSnapshotTestJSON-988246926 None] Creating offline snapshot 3b8c649a-f015-4940-af9a-1974b91fc16e of volume 04545bbc-42bd-4b87-993d-2e700b2dd385 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:47:00 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[3552a849-50fc-4222-83f9-747c04dd06e0]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-86331309-7596-47ac-ac3f-53798327cf58 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:01 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385 Nov 06 18:47:01 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:01 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-86331309-7596-47ac-ac3f-53798327cf58 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385" returned: 0 in 0.589s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-86331309-7596-47ac-ac3f-53798327cf58 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:01 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e 1G Nov 06 18:47:01 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:02 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-86331309-7596-47ac-ac3f-53798327cf58 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e 1G" returned: 0 in 0.816s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-86331309-7596-47ac-ac3f-53798327cf58 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04545bbc-42bd-4b87-993d-2e700b2dd385 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:02 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04545bbc-42bd-4b87-993d-2e700b2dd385 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e Nov 06 18:47:02 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:02 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-86331309-7596-47ac-ac3f-53798327cf58 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04545bbc-42bd-4b87-993d-2e700b2dd385 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e" returned: 0 in 0.486s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:02 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-86331309-7596-47ac-ac3f-53798327cf58 tempest-VolumesSnapshotTestJSON-988246926 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e is being set with open permissions: ugo+rw Nov 06 18:47:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-86331309-7596-47ac-ac3f-53798327cf58 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:02 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e Nov 06 18:47:02 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:03 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-86331309-7596-47ac-ac3f-53798327cf58 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e" returned: 0 in 0.301s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:03 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=110,cinder:UPDATE=125,cinder:INSERT=31,cinder:DELETE=10 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:47:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-86331309-7596-47ac-ac3f-53798327cf58 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:03 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.info Nov 06 18:47:03 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:03 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-86331309-7596-47ac-ac3f-53798327cf58 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.info" returned: 0 in 0.353s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:03 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-86331309-7596-47ac-ac3f-53798327cf58 tempest-VolumesSnapshotTestJSON-988246926 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.info is being set with open permissions: ugo+rw Nov 06 18:47:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-86331309-7596-47ac-ac3f-53798327cf58 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:03 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.info Nov 06 18:47:03 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:04 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-86331309-7596-47ac-ac3f-53798327cf58 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.info" returned: 0 in 0.437s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-86331309-7596-47ac-ac3f-53798327cf58 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.168s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:04 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-86331309-7596-47ac-ac3f-53798327cf58 tempest-VolumesSnapshotTestJSON-988246926 None] Create snapshot completed successfully Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Flow 'volume_create_manager' (3e64821b-f675-44fd-a24d-49a85ae1476f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989fd06c-816c-4064-b863-8b34cd1102cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989fd06c-816c-4064-b863-8b34cd1102cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a1d2c2-372c-45be-b6c7-58db3a8d9c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9191f9a9d7a4f19873bdae009e0bc92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:47:04Z,use_quota=True,user_id='b76a30b5e2014e419d3c1a8db99e2247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (524414eb-8919-4d3e-8755-18327eb6ab46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (524414eb-8919-4d3e-8755-18327eb6ab46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ade184-70fe-49db-b1de-36769d7a0f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ade184-70fe-49db-b1de-36769d7a0f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12a1d2c2-372c-45be-b6c7-58db3a8d9c9c', 'volume_name': 'volume-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5373e124-c35b-4bf9-9dd3-e721e09b4bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5373e124-c35b-4bf9-9dd3-e721e09b4bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601e7ba1-561c-4ee8-a80b-8c3ef2a47b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:04 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Volume 12a1d2c2-372c-45be-b6c7-58db3a8d9c9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c', 'volume_size': 1} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a1d2c2-372c-45be-b6c7-58db3a8d9c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9191f9a9d7a4f19873bdae009e0bc92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:47:04Z,use_quota=True,user_id='b76a30b5e2014e419d3c1a8db99e2247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Creating volume 12a1d2c2-372c-45be-b6c7-58db3a8d9c9c {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:47:04 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:04 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c 1073741824 Nov 06 18:47:04 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:04 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c 1073741824" returned: 0 in 0.487s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:04 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c Nov 06 18:47:04 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:05 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c" returned: 0 in 0.255s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:47:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601e7ba1-561c-4ee8-a80b-8c3ef2a47b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615f89ac-31e7-42ca-8d21-08dc65117d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:05 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Volume volume-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c (12a1d2c2-372c-45be-b6c7-58db3a8d9c9c): created successfully Nov 06 18:47:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615f89ac-31e7-42ca-8d21-08dc65117d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Flow 'volume_create_manager' (3e64821b-f675-44fd-a24d-49a85ae1476f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:47:05 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-b0f620af-e059-4f9f-ac08-40912f16221b tempest-CinderUnicodeTest-592763626 None] Created volume successfully. Nov 06 18:47:05 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:47:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Flow 'volume_create_manager' (d7067755-bbfa-4d69-b1d0-de842acd1ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:47:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b8bb8b-d0d1-454d-ab27-b1effcdb7948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b8bb8b-d0d1-454d-ab27-b1effcdb7948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-793615745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58cd9a40-f735-4d08-a2f3-fea98d80bea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ffebc70c0e404c93d12da105c49fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:47:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3b8c649a-f015-4940-af9a-1974b91fc16e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:47:06Z,use_quota=True,user_id='3d18358a482348ef9d9cfeacdea41b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d58347-0580-4eff-914a-b91cfdd1b91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d58347-0580-4eff-914a-b91cfdd1b91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b3941d-2716-4c20-a0dd-7041f2529120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b3941d-2716-4c20-a0dd-7041f2529120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '58cd9a40-f735-4d08-a2f3-fea98d80bea9', 'volume_name': 'volume-58cd9a40-f735-4d08-a2f3-fea98d80bea9', 'volume_size': 2, 'snapshot_id': '3b8c649a-f015-4940-af9a-1974b91fc16e'}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b873c5ce-a657-49fc-99c4-1383d29e357a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b873c5ce-a657-49fc-99c4-1383d29e357a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf443fe-53d2-4fb3-914b-ad1ef111e667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:06 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Volume 58cd9a40-f735-4d08-a2f3-fea98d80bea9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-58cd9a40-f735-4d08-a2f3-fea98d80bea9', 'volume_size': 2, 'snapshot_id': '3b8c649a-f015-4940-af9a-1974b91fc16e'} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-quobyte-3b8c649a-f015-4940-af9a-1974b91fc16e-58cd9a40-f735-4d08-a2f3-fea98d80bea9" by "_create_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-3b8c649a-f015-4940-af9a-1974b91fc16e-58cd9a40-f735-4d08-a2f3-fea98d80bea9" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Creating volume 58cd9a40-f735-4d08-a2f3-fea98d80bea9 from snapshot 3b8c649a-f015-4940-af9a-1974b91fc16e {{(pid=86794) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-quobyte-58cd9a40-f735-4d08-a2f3-fea98d80bea9" by "_copy_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-58cd9a40-f735-4d08-a2f3-fea98d80bea9" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] snapshot: 3b8c649a-f015-4940-af9a-1974b91fc16e, volume: 58cd9a40-f735-4d08-a2f3-fea98d80bea9, {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1996dae-9b38-4a07-8aa8-46ad94cf3077]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:06 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e Nov 06 18:47:06 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:06 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e" returned: 0 in 0.524s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04545bbc-42bd-4b87-993d-2e700b2dd385(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8f7e27-4c8c-49dc-b7aa-a4492936d366]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:06 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385 Nov 06 18:47:06 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:07 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:47:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Flow 'volume_create_manager' (3053b53f-2dfb-48a3-bbc9-7f663f7ce528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:47:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a79e0fd-9b5f-43ed-b3e7-ae462750270c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a79e0fd-9b5f-43ed-b3e7-ae462750270c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:47:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-560916324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b3f02c-71d3-4143-9ada-8172bfb0f3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9191f9a9d7a4f19873bdae009e0bc92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:47:07Z,use_quota=True,user_id='b76a30b5e2014e419d3c1a8db99e2247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4e15d1-b66d-4c43-9d9c-5bce4cd9ed69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4e15d1-b66d-4c43-9d9c-5bce4cd9ed69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e15ec96-1208-495d-891d-b49a76536ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e15ec96-1208-495d-891d-b49a76536ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74b3f02c-71d3-4143-9ada-8172bfb0f3c6', 'volume_name': 'volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a76e8a3-d839-467f-bd6a-d447d3ece820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a76e8a3-d839-467f-bd6a-d447d3ece820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08cb6724-edf8-4620-a957-2f1c958b8002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:07 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Volume 74b3f02c-71d3-4143-9ada-8172bfb0f3c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6', 'volume_size': 1} Nov 06 18:47:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:07 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385" returned: 0 in 0.449s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385 {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 18:47:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Creating direct copy from snapshot {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 18:47:07 devstack cinder-volume[86794]: DEBUG cinder.utils [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Path /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58cd9a40-f735-4d08-a2f3-fea98d80bea9 not found in is_blk_device check {{(pid=86794) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 18:47:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58cd9a40-f735-4d08-a2f3-fea98d80bea9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:07 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58cd9a40-f735-4d08-a2f3-fea98d80bea9 Nov 06 18:47:07 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:15 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58cd9a40-f735-4d08-a2f3-fea98d80bea9" returned: 0 in 7.812s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385, size 1024.00 MB, duration 7.81 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58cd9a40-f735-4d08-a2f3-fea98d80bea9 {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:47:15 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Converted 1024.00 MB image at 131.07 MB/s Nov 06 18:47:15 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58cd9a40-f735-4d08-a2f3-fea98d80bea9 is being set with open permissions: ugo+rw Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58cd9a40-f735-4d08-a2f3-fea98d80bea9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:15 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58cd9a40-f735-4d08-a2f3-fea98d80bea9 Nov 06 18:47:15 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:15 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58cd9a40-f735-4d08-a2f3-fea98d80bea9" returned: 0 in 0.254s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-58cd9a40-f735-4d08-a2f3-fea98d80bea9" released by "_copy_volume_from_snapshot" :: held 9.206s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-3b8c649a-f015-4940-af9a-1974b91fc16e-58cd9a40-f735-4d08-a2f3-fea98d80bea9" released by "_create_volume_from_snapshot" :: held 9.309s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.333s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.268s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:47:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-560916324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b3f02c-71d3-4143-9ada-8172bfb0f3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9191f9a9d7a4f19873bdae009e0bc92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:47:07Z,use_quota=True,user_id='b76a30b5e2014e419d3c1a8db99e2247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Creating volume 74b3f02c-71d3-4143-9ada-8172bfb0f3c6 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:47:15 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:15 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6 1073741824 Nov 06 18:47:15 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf443fe-53d2-4fb3-914b-ad1ef111e667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58cd9a40-f735-4d08-a2f3-fea98d80bea9', 'volume_size': 2, 'snapshot_id': '3b8c649a-f015-4940-af9a-1974b91fc16e'}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c1d883-282f-4a61-9d74-400c8077094f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:15 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Volume volume-58cd9a40-f735-4d08-a2f3-fea98d80bea9 (58cd9a40-f735-4d08-a2f3-fea98d80bea9): created successfully Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c1d883-282f-4a61-9d74-400c8077094f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Flow 'volume_create_manager' (d7067755-bbfa-4d69-b1d0-de842acd1ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:47:15 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-321de6c7-1dc2-4f7a-a0bf-6168e7bc69f6 tempest-VolumesSnapshotTestJSON-988246926 None] Created volume successfully. Nov 06 18:47:15 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6 1073741824" returned: 0 in 0.473s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:16 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6 Nov 06 18:47:16 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9e6fdb93-fbfd-45da-ae2e-e38849e65f47 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-58cd9a40-f735-4d08-a2f3-fea98d80bea9-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9e6fdb93-fbfd-45da-ae2e-e38849e65f47 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-58cd9a40-f735-4d08-a2f3-fea98d80bea9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9e6fdb93-fbfd-45da-ae2e-e38849e65f47 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-quobyte-58cd9a40-f735-4d08-a2f3-fea98d80bea9" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9e6fdb93-fbfd-45da-ae2e-e38849e65f47 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-58cd9a40-f735-4d08-a2f3-fea98d80bea9" acquired by "delete_volume" :: waited 0.027s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:16 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b75ecf-8cb2-439a-9de7-b0a1675d7658]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9e6fdb93-fbfd-45da-ae2e-e38849e65f47 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58cd9a40-f735-4d08-a2f3-fea98d80bea9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:16 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6" returned: 0 in 0.350s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:47:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08cb6724-edf8-4620-a957-2f1c958b8002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9acd5168-e013-4058-8977-ec850baaa2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:16 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Volume volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6 (74b3f02c-71d3-4143-9ada-8172bfb0f3c6): created successfully Nov 06 18:47:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9acd5168-e013-4058-8977-ec850baaa2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Flow 'volume_create_manager' (3053b53f-2dfb-48a3-bbc9-7f663f7ce528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:47:16 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-9b23bf5f-db25-4255-b162-57a6d0ec2981 tempest-CinderUnicodeTest-592763626 None] Created volume successfully. Nov 06 18:47:16 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58cd9a40-f735-4d08-a2f3-fea98d80bea9 Nov 06 18:47:16 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:16 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9e6fdb93-fbfd-45da-ae2e-e38849e65f47 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58cd9a40-f735-4d08-a2f3-fea98d80bea9" returned: 0 in 0.440s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9e6fdb93-fbfd-45da-ae2e-e38849e65f47 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58cd9a40-f735-4d08-a2f3-fea98d80bea9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:16 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58cd9a40-f735-4d08-a2f3-fea98d80bea9 Nov 06 18:47:16 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:16 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9e6fdb93-fbfd-45da-ae2e-e38849e65f47 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58cd9a40-f735-4d08-a2f3-fea98d80bea9" returned: 0 in 0.302s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9e6fdb93-fbfd-45da-ae2e-e38849e65f47 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-58cd9a40-f735-4d08-a2f3-fea98d80bea9" released by "delete_volume" :: held 0.800s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-9e6fdb93-fbfd-45da-ae2e-e38849e65f47 tempest-VolumesSnapshotTestJSON-988246926 None] Created reservations ['0177b2ef-2071-469a-b362-916bd8fc364d', 'f7450937-c24e-4364-b60e-254bfc230643', '1271e286-dd8a-46c2-b908-b5dc4454843c', 'd44b5376-8fe2-4d09-9f0b-4c818e0f4e1c'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9e6fdb93-fbfd-45da-ae2e-e38849e65f47 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9e6fdb93-fbfd-45da-ae2e-e38849e65f47 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9e6fdb93-fbfd-45da-ae2e-e38849e65f47 tempest-VolumesSnapshotTestJSON-988246926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9e6fdb93-fbfd-45da-ae2e-e38849e65f47 tempest-VolumesSnapshotTestJSON-988246926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9e6fdb93-fbfd-45da-ae2e-e38849e65f47 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9e6fdb93-fbfd-45da-ae2e-e38849e65f47 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:17 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:47:17 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-3b8c649a-f015-4940-af9a-1974b91fc16e-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-3b8c649a-f015-4940-af9a-1974b91fc16e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-quobyte-04545bbc-42bd-4b87-993d-2e700b2dd385" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-04545bbc-42bd-4b87-993d-2e700b2dd385" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-quobyte-3b8c649a-f015-4940-af9a-1974b91fc16e" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-3b8c649a-f015-4940-af9a-1974b91fc16e" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] Deleting offline snapshot 3b8c649a-f015-4940-af9a-1974b91fc16e of volume 04545bbc-42bd-4b87-993d-2e700b2dd385 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] snapshot_file for this snap is: volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[06940dfa-1813-4829-a93e-41184716340f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:17 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-461a0b65-4744-45c2-9c5b-a710cc0a3292 tempest-CinderUnicodeTest-592763626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-461a0b65-4744-45c2-9c5b-a710cc0a3292 tempest-CinderUnicodeTest-592763626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9e6fdb93-fbfd-45da-ae2e-e38849e65f47 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.447s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-9e6fdb93-fbfd-45da-ae2e-e38849e65f47 tempest-VolumesSnapshotTestJSON-988246926 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:47:17 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-9e6fdb93-fbfd-45da-ae2e-e38849e65f47 tempest-VolumesSnapshotTestJSON-988246926 None] Deleted volume successfully. Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-461a0b65-4744-45c2-9c5b-a710cc0a3292 tempest-CinderUnicodeTest-592763626 None] Creating offline snapshot 45634d8f-0e7c-400f-81c4-7278b1416cb3 of volume 74b3f02c-71d3-4143-9ada-8172bfb0f3c6 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf5bd7a-1f93-4c56-912a-bd70120d72d2]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-461a0b65-4744-45c2-9c5b-a710cc0a3292 tempest-CinderUnicodeTest-592763626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:17 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e Nov 06 18:47:17 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9e6fdb93-fbfd-45da-ae2e-e38849e65f47 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-58cd9a40-f735-4d08-a2f3-fea98d80bea9-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:17 devstack sudo[103589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6 Nov 06 18:47:17 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:18 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e" returned: 0 in 0.515s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04545bbc-42bd-4b87-993d-2e700b2dd385(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:47:18 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5fa97a-f1d8-4af4-8d71-018e5bc4edbe]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:18 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-461a0b65-4744-45c2-9c5b-a710cc0a3292 tempest-CinderUnicodeTest-592763626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6" returned: 0 in 0.462s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-461a0b65-4744-45c2-9c5b-a710cc0a3292 tempest-CinderUnicodeTest-592763626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.45634d8f-0e7c-400f-81c4-7278b1416cb3 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:18 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.45634d8f-0e7c-400f-81c4-7278b1416cb3 1G Nov 06 18:47:18 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-6a62756b-5ccf-4308-bc98-1d6936136d80 req-ee1c2f43-bdc3-496c-b609-54b80ab39856 tempest-TestServerVolumeAttachmentScenario-75865889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:18 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385 Nov 06 18:47:18 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:18 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-461a0b65-4744-45c2-9c5b-a710cc0a3292 tempest-CinderUnicodeTest-592763626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.45634d8f-0e7c-400f-81c4-7278b1416cb3 1G" returned: 0 in 0.426s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-461a0b65-4744-45c2-9c5b-a710cc0a3292 tempest-CinderUnicodeTest-592763626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.45634d8f-0e7c-400f-81c4-7278b1416cb3 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:18 devstack sudo[103639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.45634d8f-0e7c-400f-81c4-7278b1416cb3 Nov 06 18:47:18 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:18 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385" returned: 0 in 0.566s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:18 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e Nov 06 18:47:18 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:18 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-461a0b65-4744-45c2-9c5b-a710cc0a3292 tempest-CinderUnicodeTest-592763626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.45634d8f-0e7c-400f-81c4-7278b1416cb3" returned: 0 in 0.305s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:18 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-461a0b65-4744-45c2-9c5b-a710cc0a3292 tempest-CinderUnicodeTest-592763626 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.45634d8f-0e7c-400f-81c4-7278b1416cb3 is being set with open permissions: ugo+rw Nov 06 18:47:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-461a0b65-4744-45c2-9c5b-a710cc0a3292 tempest-CinderUnicodeTest-592763626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.45634d8f-0e7c-400f-81c4-7278b1416cb3 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:18 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.45634d8f-0e7c-400f-81c4-7278b1416cb3 Nov 06 18:47:18 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:19 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e" returned: 0 in 0.370s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:19 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e Nov 06 18:47:19 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:19 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-461a0b65-4744-45c2-9c5b-a710cc0a3292 tempest-CinderUnicodeTest-592763626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.45634d8f-0e7c-400f-81c4-7278b1416cb3" returned: 0 in 0.257s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-461a0b65-4744-45c2-9c5b-a710cc0a3292 tempest-CinderUnicodeTest-592763626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:19 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.info Nov 06 18:47:19 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:19 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385.3b8c649a-f015-4940-af9a-1974b91fc16e" returned: 0 in 0.256s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-3b8c649a-f015-4940-af9a-1974b91fc16e" released by "_delete_snapshot" :: held 1.847s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-04545bbc-42bd-4b87-993d-2e700b2dd385" released by "delete_snapshot" :: held 1.896s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] Created reservations ['50c8cfc4-2c8f-4851-9237-4d23bd2b7b0d', 'c05af07e-6386-4a04-a19c-9e77eaf37a46', '4b3a97a3-34da-4ab7-9ba6-6d9e8c198bde', '7b70101c-4d6f-4bc2-b112-0ed0758d6eac'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:47:19 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-461a0b65-4744-45c2-9c5b-a710cc0a3292 tempest-CinderUnicodeTest-592763626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.info" returned: 0 in 0.266s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:19 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-461a0b65-4744-45c2-9c5b-a710cc0a3292 tempest-CinderUnicodeTest-592763626 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.info is being set with open permissions: ugo+rw Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-461a0b65-4744-45c2-9c5b-a710cc0a3292 tempest-CinderUnicodeTest-592763626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:19 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.info Nov 06 18:47:19 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:19 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] Delete snapshot completed successfully. Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-eb6cc861-7951-4ec3-9c92-b044941501f1 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-3b8c649a-f015-4940-af9a-1974b91fc16e-delete_snapshot" released by "delete_snapshot" :: held 2.059s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-18a3fe90-c5ce-4c4e-84ee-3714a7febb84 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-04545bbc-42bd-4b87-993d-2e700b2dd385-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-18a3fe90-c5ce-4c4e-84ee-3714a7febb84 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-04545bbc-42bd-4b87-993d-2e700b2dd385-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-18a3fe90-c5ce-4c4e-84ee-3714a7febb84 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-quobyte-04545bbc-42bd-4b87-993d-2e700b2dd385" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-18a3fe90-c5ce-4c4e-84ee-3714a7febb84 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-04545bbc-42bd-4b87-993d-2e700b2dd385" acquired by "delete_volume" :: waited 0.017s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:19 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-461a0b65-4744-45c2-9c5b-a710cc0a3292 tempest-CinderUnicodeTest-592763626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.info" returned: 0 in 0.297s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-461a0b65-4744-45c2-9c5b-a710cc0a3292 tempest-CinderUnicodeTest-592763626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.145s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bf1714-e5ff-48da-9ecd-363c455e98c9]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-6a62756b-5ccf-4308-bc98-1d6936136d80 req-ee1c2f43-bdc3-496c-b609-54b80ab39856 tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.569s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a3fe90-c5ce-4c4e-84ee-3714a7febb84 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-6a62756b-5ccf-4308-bc98-1d6936136d80 req-ee1c2f43-bdc3-496c-b609-54b80ab39856 tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:19 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-461a0b65-4744-45c2-9c5b-a710cc0a3292 tempest-CinderUnicodeTest-592763626 None] Create snapshot completed successfully Nov 06 18:47:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-6a62756b-5ccf-4308-bc98-1d6936136d80 req-ee1c2f43-bdc3-496c-b609-54b80ab39856 tempest-TestServerVolumeAttachmentScenario-75865889 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-4a2e8a54-a6cf-463c-88db-14b12a17bf4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ba03679-070a-4adc-b430-9d501af26942', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:47:19 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385 Nov 06 18:47:19 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:19 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-6a62756b-5ccf-4308-bc98-1d6936136d80 req-ee1c2f43-bdc3-496c-b609-54b80ab39856 tempest-TestServerVolumeAttachmentScenario-75865889 None] attachment_update completed successfully. Nov 06 18:47:20 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a3fe90-c5ce-4c4e-84ee-3714a7febb84 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385" returned: 0 in 0.396s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a3fe90-c5ce-4c4e-84ee-3714a7febb84 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:20 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385 Nov 06 18:47:20 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:20 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a3fe90-c5ce-4c4e-84ee-3714a7febb84 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-04545bbc-42bd-4b87-993d-2e700b2dd385" returned: 0 in 0.275s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-18a3fe90-c5ce-4c4e-84ee-3714a7febb84 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-04545bbc-42bd-4b87-993d-2e700b2dd385" released by "delete_volume" :: held 0.762s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-18a3fe90-c5ce-4c4e-84ee-3714a7febb84 tempest-VolumesSnapshotTestJSON-988246926 None] Created reservations ['601f62fa-2cc5-42d8-ba04-047d838971ee', '50e3851f-2cc9-4ac2-bb8d-ec0f939c5390', 'b532c0cd-41e0-455e-9493-8d46c00623a6', 'b4d712dd-206b-434b-bae1-72a6b24795f1'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-18a3fe90-c5ce-4c4e-84ee-3714a7febb84 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-18a3fe90-c5ce-4c4e-84ee-3714a7febb84 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-18a3fe90-c5ce-4c4e-84ee-3714a7febb84 tempest-VolumesSnapshotTestJSON-988246926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-18a3fe90-c5ce-4c4e-84ee-3714a7febb84 tempest-VolumesSnapshotTestJSON-988246926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-18a3fe90-c5ce-4c4e-84ee-3714a7febb84 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a3fe90-c5ce-4c4e-84ee-3714a7febb84 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:20 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:47:20 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] Acquiring lock "cinder-45634d8f-0e7c-400f-81c4-7278b1416cb3-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] Lock "cinder-45634d8f-0e7c-400f-81c4-7278b1416cb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] Acquiring lock "cinder-quobyte-74b3f02c-71d3-4143-9ada-8172bfb0f3c6" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] Lock "cinder-quobyte-74b3f02c-71d3-4143-9ada-8172bfb0f3c6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] Acquiring lock "cinder-quobyte-45634d8f-0e7c-400f-81c4-7278b1416cb3" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] Lock "cinder-quobyte-45634d8f-0e7c-400f-81c4-7278b1416cb3" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] Deleting offline snapshot 45634d8f-0e7c-400f-81c4-7278b1416cb3 of volume 74b3f02c-71d3-4143-9ada-8172bfb0f3c6 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] snapshot_file for this snap is: volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.45634d8f-0e7c-400f-81c4-7278b1416cb3 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f863f7b-9765-47c1-88dc-cb7e0b7d8b21]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.45634d8f-0e7c-400f-81c4-7278b1416cb3 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:20 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a3fe90-c5ce-4c4e-84ee-3714a7febb84 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.285s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-18a3fe90-c5ce-4c4e-84ee-3714a7febb84 tempest-VolumesSnapshotTestJSON-988246926 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:47:20 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-18a3fe90-c5ce-4c4e-84ee-3714a7febb84 tempest-VolumesSnapshotTestJSON-988246926 None] Deleted volume successfully. Nov 06 18:47:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-18a3fe90-c5ce-4c4e-84ee-3714a7febb84 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-04545bbc-42bd-4b87-993d-2e700b2dd385-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:21 devstack sudo[103679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.45634d8f-0e7c-400f-81c4-7278b1416cb3 Nov 06 18:47:21 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:21 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.45634d8f-0e7c-400f-81c4-7278b1416cb3" returned: 0 in 0.410s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[594f9a08-08a2-490c-a3ec-8e575af060f4]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Flow 'volume_create_manager' (0d8473ce-a2d1-4dbd-80cd-f5ac7007b59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef21ed51-0dd0-44eb-8954-a7c17f4ba27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef21ed51-0dd0-44eb-8954-a7c17f4ba27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1332829017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984c1110-10cf-43af-9cdd-1189111b3a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ffebc70c0e404c93d12da105c49fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:47:21Z,use_quota=True,user_id='3d18358a482348ef9d9cfeacdea41b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6592b32-ded3-4da4-9136-2d4f06f34bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:21 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6 Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6592b32-ded3-4da4-9136-2d4f06f34bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:21 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48b88af-ff47-4548-9b41-c54cd0b1da60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48b88af-ff47-4548-9b41-c54cd0b1da60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '984c1110-10cf-43af-9cdd-1189111b3a2a', 'volume_name': 'volume-984c1110-10cf-43af-9cdd-1189111b3a2a', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd79ad3a-7e82-44f2-bd1e-e6e5fff51a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd79ad3a-7e82-44f2-bd1e-e6e5fff51a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00a5088-d16b-4f6a-8640-fdddd60eb985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:21 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Volume 984c1110-10cf-43af-9cdd-1189111b3a2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-984c1110-10cf-43af-9cdd-1189111b3a2a', 'volume_size': 1} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1332829017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984c1110-10cf-43af-9cdd-1189111b3a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ffebc70c0e404c93d12da105c49fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:47:21Z,use_quota=True,user_id='3d18358a482348ef9d9cfeacdea41b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Creating volume 984c1110-10cf-43af-9cdd-1189111b3a2a {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:47:21 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:21 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a 1073741824 Nov 06 18:47:21 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:21 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6" returned: 0 in 0.428s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.45634d8f-0e7c-400f-81c4-7278b1416cb3 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:21 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.45634d8f-0e7c-400f-81c4-7278b1416cb3 Nov 06 18:47:21 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:22 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a 1073741824" returned: 0 in 0.534s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:22 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a Nov 06 18:47:22 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:22 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.45634d8f-0e7c-400f-81c4-7278b1416cb3" returned: 0 in 0.396s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.45634d8f-0e7c-400f-81c4-7278b1416cb3 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:22 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.45634d8f-0e7c-400f-81c4-7278b1416cb3 Nov 06 18:47:22 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:22 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a" returned: 0 in 0.293s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:22 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:47:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:22 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00a5088-d16b-4f6a-8640-fdddd60eb985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-984c1110-10cf-43af-9cdd-1189111b3a2a', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:22 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548caf5b-3c09-4af0-867f-d497536d3712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:22 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Volume volume-984c1110-10cf-43af-9cdd-1189111b3a2a (984c1110-10cf-43af-9cdd-1189111b3a2a): created successfully Nov 06 18:47:22 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548caf5b-3c09-4af0-867f-d497536d3712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:22 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Flow 'volume_create_manager' (0d8473ce-a2d1-4dbd-80cd-f5ac7007b59c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:47:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-7cf173f4-f771-4101-82ec-3e7e1dba2b14 tempest-VolumesSnapshotTestJSON-988246926 None] Created volume successfully. Nov 06 18:47:22 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6.45634d8f-0e7c-400f-81c4-7278b1416cb3" returned: 0 in 0.298s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] Lock "cinder-quobyte-45634d8f-0e7c-400f-81c4-7278b1416cb3" released by "_delete_snapshot" :: held 1.686s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] Lock "cinder-quobyte-74b3f02c-71d3-4143-9ada-8172bfb0f3c6" released by "delete_snapshot" :: held 1.723s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:22 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] Created reservations ['e0cb9656-4d52-4be4-a2f4-6c8cd2fe0214', '8c31a256-6bb6-420b-8515-3685fe87b441', 'e97a401d-cf75-4cda-8051-26a7023de26a', '2a23125b-cb5c-4c55-ad90-a41ca54da407'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:47:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] Delete snapshot completed successfully. Nov 06 18:47:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-78b56402-ec19-436e-98de-975d007488bf tempest-CinderUnicodeTest-592763626 None] Lock "cinder-45634d8f-0e7c-400f-81c4-7278b1416cb3-delete_snapshot" released by "delete_snapshot" :: held 1.856s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1b516156-865b-4407-b713-d2fee99f11f8 tempest-CinderUnicodeTest-592763626 None] Acquiring lock "cinder-74b3f02c-71d3-4143-9ada-8172bfb0f3c6-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1b516156-865b-4407-b713-d2fee99f11f8 tempest-CinderUnicodeTest-592763626 None] Lock "cinder-74b3f02c-71d3-4143-9ada-8172bfb0f3c6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1b516156-865b-4407-b713-d2fee99f11f8 tempest-CinderUnicodeTest-592763626 None] Acquiring lock "cinder-quobyte-74b3f02c-71d3-4143-9ada-8172bfb0f3c6" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1b516156-865b-4407-b713-d2fee99f11f8 tempest-CinderUnicodeTest-592763626 None] Lock "cinder-quobyte-74b3f02c-71d3-4143-9ada-8172bfb0f3c6" acquired by "delete_volume" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:23 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[192c80ce-0989-49a0-8d03-84f8bb48e76d]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1b516156-865b-4407-b713-d2fee99f11f8 tempest-CinderUnicodeTest-592763626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:23 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6 Nov 06 18:47:23 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:23 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1b516156-865b-4407-b713-d2fee99f11f8 tempest-CinderUnicodeTest-592763626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6" returned: 0 in 0.399s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1b516156-865b-4407-b713-d2fee99f11f8 tempest-CinderUnicodeTest-592763626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:23 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6 Nov 06 18:47:23 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:23 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1b516156-865b-4407-b713-d2fee99f11f8 tempest-CinderUnicodeTest-592763626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-74b3f02c-71d3-4143-9ada-8172bfb0f3c6" returned: 0 in 0.300s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1b516156-865b-4407-b713-d2fee99f11f8 tempest-CinderUnicodeTest-592763626 None] Lock "cinder-quobyte-74b3f02c-71d3-4143-9ada-8172bfb0f3c6" released by "delete_volume" :: held 0.805s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-18a44c4b-500c-4317-b7f7-482fe0074bd2 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-18a44c4b-500c-4317-b7f7-482fe0074bd2 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-18a44c4b-500c-4317-b7f7-482fe0074bd2 tempest-VolumesSnapshotTestJSON-988246926 None] Creating offline snapshot 073c07ad-0740-42f6-98eb-65fea61d3cf0 of volume 984c1110-10cf-43af-9cdd-1189111b3a2a {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:47:23 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-1b516156-865b-4407-b713-d2fee99f11f8 tempest-CinderUnicodeTest-592763626 None] Created reservations ['097e24c2-856a-4bff-91c3-411af1bcf331', '973082bb-afec-453a-9037-cd3089fb3a10', '6d6fe022-94e5-412a-9fc3-a3a7560e8028', '5af3f61b-e46c-47af-817d-09603f971d00'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:47:23 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd6976e-e3b3-4d60-9cf9-9740f92682bd]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a44c4b-500c-4317-b7f7-482fe0074bd2 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1b516156-865b-4407-b713-d2fee99f11f8 tempest-CinderUnicodeTest-592763626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1b516156-865b-4407-b713-d2fee99f11f8 tempest-CinderUnicodeTest-592763626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1b516156-865b-4407-b713-d2fee99f11f8 tempest-CinderUnicodeTest-592763626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:47:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1b516156-865b-4407-b713-d2fee99f11f8 tempest-CinderUnicodeTest-592763626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:47:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1b516156-865b-4407-b713-d2fee99f11f8 tempest-CinderUnicodeTest-592763626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1b516156-865b-4407-b713-d2fee99f11f8 tempest-CinderUnicodeTest-592763626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:24 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a Nov 06 18:47:24 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:24 devstack sudo[103728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:47:24 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:24 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a293b131-837d-45ee-8037-a00a98c97c74 tempest-CinderUnicodeTest-592763626 None] Acquiring lock "cinder-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:24 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a293b131-837d-45ee-8037-a00a98c97c74 tempest-CinderUnicodeTest-592763626 None] Lock "cinder-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:24 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a293b131-837d-45ee-8037-a00a98c97c74 tempest-CinderUnicodeTest-592763626 None] Acquiring lock "cinder-quobyte-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:24 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a293b131-837d-45ee-8037-a00a98c97c74 tempest-CinderUnicodeTest-592763626 None] Lock "cinder-quobyte-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c" acquired by "delete_volume" :: waited 0.024s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:24 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3db056-2013-40d0-a263-eae7320cc6d4]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a293b131-837d-45ee-8037-a00a98c97c74 tempest-CinderUnicodeTest-592763626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-52c11895-27dd-42cd-be04-e71edaddc56c req-0497e6b0-2f1c-45ce-b853-ae2515ccb945 tempest-TestServerVolumeAttachmentScenario-75865889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:24 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1b516156-865b-4407-b713-d2fee99f11f8 tempest-CinderUnicodeTest-592763626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.368s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:24 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:24 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-1b516156-865b-4407-b713-d2fee99f11f8 tempest-CinderUnicodeTest-592763626 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:47:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a44c4b-500c-4317-b7f7-482fe0074bd2 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a" returned: 0 in 0.508s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a44c4b-500c-4317-b7f7-482fe0074bd2 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:24 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c Nov 06 18:47:24 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:24 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-1b516156-865b-4407-b713-d2fee99f11f8 tempest-CinderUnicodeTest-592763626 None] Deleted volume successfully. Nov 06 18:47:24 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0 1G Nov 06 18:47:24 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:24 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1b516156-865b-4407-b713-d2fee99f11f8 tempest-CinderUnicodeTest-592763626 None] Lock "cinder-74b3f02c-71d3-4143-9ada-8172bfb0f3c6-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:24 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a293b131-837d-45ee-8037-a00a98c97c74 tempest-CinderUnicodeTest-592763626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c" returned: 0 in 0.446s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a293b131-837d-45ee-8037-a00a98c97c74 tempest-CinderUnicodeTest-592763626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:24 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c Nov 06 18:47:24 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:25 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a44c4b-500c-4317-b7f7-482fe0074bd2 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0 1G" returned: 0 in 0.578s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a44c4b-500c-4317-b7f7-482fe0074bd2 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-984c1110-10cf-43af-9cdd-1189111b3a2a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:25 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-984c1110-10cf-43af-9cdd-1189111b3a2a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0 Nov 06 18:47:25 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:25 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a293b131-837d-45ee-8037-a00a98c97c74 tempest-CinderUnicodeTest-592763626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c" returned: 0 in 0.342s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a293b131-837d-45ee-8037-a00a98c97c74 tempest-CinderUnicodeTest-592763626 None] Lock "cinder-quobyte-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c" released by "delete_volume" :: held 0.863s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:25 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-a293b131-837d-45ee-8037-a00a98c97c74 tempest-CinderUnicodeTest-592763626 None] Created reservations ['7caf667f-d53a-46ec-8c46-6dab59fdbfea', '07728208-7401-4861-bf86-47c888292224', '0fde8334-49ae-405b-b84a-e675c560a300', 'c39b02d7-03b2-49b0-89e6-342737476640'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:47:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a293b131-837d-45ee-8037-a00a98c97c74 tempest-CinderUnicodeTest-592763626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a293b131-837d-45ee-8037-a00a98c97c74 tempest-CinderUnicodeTest-592763626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a293b131-837d-45ee-8037-a00a98c97c74 tempest-CinderUnicodeTest-592763626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:47:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a293b131-837d-45ee-8037-a00a98c97c74 tempest-CinderUnicodeTest-592763626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:47:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a293b131-837d-45ee-8037-a00a98c97c74 tempest-CinderUnicodeTest-592763626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a293b131-837d-45ee-8037-a00a98c97c74 tempest-CinderUnicodeTest-592763626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:25 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:47:25 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:25 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a44c4b-500c-4317-b7f7-482fe0074bd2 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-984c1110-10cf-43af-9cdd-1189111b3a2a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0" returned: 0 in 0.497s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:25 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-18a44c4b-500c-4317-b7f7-482fe0074bd2 tempest-VolumesSnapshotTestJSON-988246926 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0 is being set with open permissions: ugo+rw Nov 06 18:47:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a44c4b-500c-4317-b7f7-482fe0074bd2 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:25 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0 Nov 06 18:47:25 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:25 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a293b131-837d-45ee-8037-a00a98c97c74 tempest-CinderUnicodeTest-592763626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.337s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:25 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-a293b131-837d-45ee-8037-a00a98c97c74 tempest-CinderUnicodeTest-592763626 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:47:25 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a293b131-837d-45ee-8037-a00a98c97c74 tempest-CinderUnicodeTest-592763626 None] Deleted volume successfully. Nov 06 18:47:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a293b131-837d-45ee-8037-a00a98c97c74 tempest-CinderUnicodeTest-592763626 None] Lock "cinder-12a1d2c2-372c-45be-b6c7-58db3a8d9c9c-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:25 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a44c4b-500c-4317-b7f7-482fe0074bd2 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0" returned: 0 in 0.337s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a44c4b-500c-4317-b7f7-482fe0074bd2 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:25 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.info Nov 06 18:47:25 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:26 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a44c4b-500c-4317-b7f7-482fe0074bd2 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.info" returned: 0 in 0.308s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:26 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-18a44c4b-500c-4317-b7f7-482fe0074bd2 tempest-VolumesSnapshotTestJSON-988246926 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.info is being set with open permissions: ugo+rw Nov 06 18:47:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a44c4b-500c-4317-b7f7-482fe0074bd2 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:26 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.info Nov 06 18:47:26 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:26 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a44c4b-500c-4317-b7f7-482fe0074bd2 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.info" returned: 0 in 0.300s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-18a44c4b-500c-4317-b7f7-482fe0074bd2 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.661s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-52c11895-27dd-42cd-be04-e71edaddc56c req-0497e6b0-2f1c-45ce-b853-ae2515ccb945 tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.180s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-52c11895-27dd-42cd-be04-e71edaddc56c req-0497e6b0-2f1c-45ce-b853-ae2515ccb945 tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:26 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-18a44c4b-500c-4317-b7f7-482fe0074bd2 tempest-VolumesSnapshotTestJSON-988246926 None] Create snapshot completed successfully Nov 06 18:47:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-52c11895-27dd-42cd-be04-e71edaddc56c req-0497e6b0-2f1c-45ce-b853-ae2515ccb945 tempest-TestServerVolumeAttachmentScenario-75865889 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-c24ad99e-2255-4a99-85a1-33e277c432af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58773cf6-c762-4eef-be08-8fc6ddafa5df', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:47:26 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-52c11895-27dd-42cd-be04-e71edaddc56c req-0497e6b0-2f1c-45ce-b853-ae2515ccb945 tempest-TestServerVolumeAttachmentScenario-75865889 None] attachment_update completed successfully. Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Flow 'volume_create_manager' (f9d21be2-f39a-4087-96ac-47442e980bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5da6d2-8c11-4376-ac3b-9a4b813a1f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5da6d2-8c11-4376-ac3b-9a4b813a1f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1279961194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e739d3f-5605-4c4b-a713-7f92217091eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ffebc70c0e404c93d12da105c49fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=073c07ad-0740-42f6-98eb-65fea61d3cf0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:47:28Z,use_quota=True,user_id='3d18358a482348ef9d9cfeacdea41b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a433e62-2d86-45dc-a151-2c034ab83ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a433e62-2d86-45dc-a151-2c034ab83ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b27d8ad3-5c7f-4518-b3da-e72fef8d313c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b27d8ad3-5c7f-4518-b3da-e72fef8d313c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0e739d3f-5605-4c4b-a713-7f92217091eb', 'volume_name': 'volume-0e739d3f-5605-4c4b-a713-7f92217091eb', 'volume_size': 1, 'snapshot_id': '073c07ad-0740-42f6-98eb-65fea61d3cf0'}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c2fa49-cff8-48d1-8425-91d27307092e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c2fa49-cff8-48d1-8425-91d27307092e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee32a57-9104-4d60-9ea2-d61dbc9723fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:27 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Volume 0e739d3f-5605-4c4b-a713-7f92217091eb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0e739d3f-5605-4c4b-a713-7f92217091eb', 'volume_size': 1, 'snapshot_id': '073c07ad-0740-42f6-98eb-65fea61d3cf0'} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-quobyte-073c07ad-0740-42f6-98eb-65fea61d3cf0-0e739d3f-5605-4c4b-a713-7f92217091eb" by "_create_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-073c07ad-0740-42f6-98eb-65fea61d3cf0-0e739d3f-5605-4c4b-a713-7f92217091eb" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Creating volume 0e739d3f-5605-4c4b-a713-7f92217091eb from snapshot 073c07ad-0740-42f6-98eb-65fea61d3cf0 {{(pid=86794) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-quobyte-0e739d3f-5605-4c4b-a713-7f92217091eb" by "_copy_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-0e739d3f-5605-4c4b-a713-7f92217091eb" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] snapshot: 073c07ad-0740-42f6-98eb-65fea61d3cf0, volume: 0e739d3f-5605-4c4b-a713-7f92217091eb, {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6aa03e-6ab6-47c2-b973-f7d3daab311c]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:27 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0 Nov 06 18:47:27 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:28 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0" returned: 0 in 0.386s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-984c1110-10cf-43af-9cdd-1189111b3a2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:47:28 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b0ef1d-e0f2-422a-b3a1-01651b08dda6]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:28 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a Nov 06 18:47:28 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:28 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a" returned: 0 in 0.436s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 18:47:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Creating direct copy from snapshot {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 18:47:28 devstack cinder-volume[86794]: DEBUG cinder.utils [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Path /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e739d3f-5605-4c4b-a713-7f92217091eb not found in is_blk_device check {{(pid=86794) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 18:47:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e739d3f-5605-4c4b-a713-7f92217091eb {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:28 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e739d3f-5605-4c4b-a713-7f92217091eb Nov 06 18:47:28 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:47:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:47:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:47:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:29 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-b009d2af-b911-4607-9b43-ccc6621de891 req-136f3c8d-d554-427c-9a3d-baf99d285c56 tempest-TestServerVolumeAttachmentScenario-75865889 None] Terminate volume connection completed successfully. Nov 06 18:47:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-b009d2af-b911-4607-9b43-ccc6621de891 req-136f3c8d-d554-427c-9a3d-baf99d285c56 tempest-TestServerVolumeAttachmentScenario-75865889 None] Deleting attachment 58773cf6-c762-4eef-be08-8fc6ddafa5df. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:47:29 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:47:29 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:29 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.380s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:47:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:47:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 29 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:47:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:47:31 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-f087ded6-8a42-498d-b410-6c3069fb6080 req-f4cc7d9a-a860-4b56-ba77-f56bc2e0c33b tempest-TestServerVolumeAttachmentScenario-75865889 None] Terminate volume connection completed successfully. Nov 06 18:47:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-f087ded6-8a42-498d-b410-6c3069fb6080 req-f4cc7d9a-a860-4b56-ba77-f56bc2e0c33b tempest-TestServerVolumeAttachmentScenario-75865889 None] Deleting attachment 7ba03679-070a-4adc-b430-9d501af26942. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:47:37 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e739d3f-5605-4c4b-a713-7f92217091eb" returned: 0 in 8.591s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:37 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a, size 1024.00 MB, duration 8.59 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e739d3f-5605-4c4b-a713-7f92217091eb {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:47:37 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Converted 1024.00 MB image at 119.18 MB/s Nov 06 18:47:37 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e739d3f-5605-4c4b-a713-7f92217091eb is being set with open permissions: ugo+rw Nov 06 18:47:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e739d3f-5605-4c4b-a713-7f92217091eb {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:37 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e739d3f-5605-4c4b-a713-7f92217091eb Nov 06 18:47:37 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:37 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e739d3f-5605-4c4b-a713-7f92217091eb" returned: 0 in 0.269s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-0e739d3f-5605-4c4b-a713-7f92217091eb" released by "_copy_volume_from_snapshot" :: held 9.789s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-073c07ad-0740-42f6-98eb-65fea61d3cf0-0e739d3f-5605-4c4b-a713-7f92217091eb" released by "_create_volume_from_snapshot" :: held 9.862s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.883s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee32a57-9104-4d60-9ea2-d61dbc9723fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e739d3f-5605-4c4b-a713-7f92217091eb', 'volume_size': 1, 'snapshot_id': '073c07ad-0740-42f6-98eb-65fea61d3cf0'}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65f7d7f-5fba-449a-90f5-a4ff293e7637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:47:37 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Volume volume-0e739d3f-5605-4c4b-a713-7f92217091eb (0e739d3f-5605-4c4b-a713-7f92217091eb): created successfully Nov 06 18:47:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65f7d7f-5fba-449a-90f5-a4ff293e7637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:47:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Flow 'volume_create_manager' (f9d21be2-f39a-4087-96ac-47442e980bd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:47:37 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-5aaf620b-bc49-40c2-affe-707577293b0d tempest-VolumesSnapshotTestJSON-988246926 None] Created volume successfully. Nov 06 18:47:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-03da72dc-0995-4c28-9783-50594cb214c7 tempest-TestServerVolumeAttachmentScenario-75865889 None] Acquiring lock "cinder-c24ad99e-2255-4a99-85a1-33e277c432af-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-03da72dc-0995-4c28-9783-50594cb214c7 tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "cinder-c24ad99e-2255-4a99-85a1-33e277c432af-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-03da72dc-0995-4c28-9783-50594cb214c7 tempest-TestServerVolumeAttachmentScenario-75865889 None] Acquiring lock "cinder-quobyte-c24ad99e-2255-4a99-85a1-33e277c432af" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-03da72dc-0995-4c28-9783-50594cb214c7 tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "cinder-quobyte-c24ad99e-2255-4a99-85a1-33e277c432af" acquired by "delete_volume" :: waited 0.017s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:38 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[65acfeca-d558-4833-8f8c-1df279dddc0e]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-03da72dc-0995-4c28-9783-50594cb214c7 tempest-TestServerVolumeAttachmentScenario-75865889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c24ad99e-2255-4a99-85a1-33e277c432af {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:38 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c24ad99e-2255-4a99-85a1-33e277c432af Nov 06 18:47:38 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:38 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-03da72dc-0995-4c28-9783-50594cb214c7 tempest-TestServerVolumeAttachmentScenario-75865889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c24ad99e-2255-4a99-85a1-33e277c432af" returned: 0 in 0.372s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-03da72dc-0995-4c28-9783-50594cb214c7 tempest-TestServerVolumeAttachmentScenario-75865889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c24ad99e-2255-4a99-85a1-33e277c432af {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:38 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c24ad99e-2255-4a99-85a1-33e277c432af Nov 06 18:47:38 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:38 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-03da72dc-0995-4c28-9783-50594cb214c7 tempest-TestServerVolumeAttachmentScenario-75865889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c24ad99e-2255-4a99-85a1-33e277c432af" returned: 0 in 0.279s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-94ba29ae-f21c-479f-9192-0c42b834c0b6 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-0e739d3f-5605-4c4b-a713-7f92217091eb-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-03da72dc-0995-4c28-9783-50594cb214c7 tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "cinder-quobyte-c24ad99e-2255-4a99-85a1-33e277c432af" released by "delete_volume" :: held 0.705s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-94ba29ae-f21c-479f-9192-0c42b834c0b6 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-0e739d3f-5605-4c4b-a713-7f92217091eb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-94ba29ae-f21c-479f-9192-0c42b834c0b6 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-quobyte-0e739d3f-5605-4c4b-a713-7f92217091eb" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:38 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-03da72dc-0995-4c28-9783-50594cb214c7 tempest-TestServerVolumeAttachmentScenario-75865889 None] Created reservations ['d3b2e81f-8b7e-44ae-ac95-4dbc09379edd', 'b4caa7a6-57f3-4e33-9863-22355acddbf0', '36523caf-c66a-4149-917a-1376ea7fbaae', 'fcd43fe9-fe11-4661-a3fb-190f404f5a38'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:47:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-94ba29ae-f21c-479f-9192-0c42b834c0b6 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-0e739d3f-5605-4c4b-a713-7f92217091eb" acquired by "delete_volume" :: waited 0.023s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:38 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1ee344-9c0b-4f22-933a-3564d061251c]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94ba29ae-f21c-479f-9192-0c42b834c0b6 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e739d3f-5605-4c4b-a713-7f92217091eb {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-03da72dc-0995-4c28-9783-50594cb214c7 tempest-TestServerVolumeAttachmentScenario-75865889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-03da72dc-0995-4c28-9783-50594cb214c7 tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-03da72dc-0995-4c28-9783-50594cb214c7 tempest-TestServerVolumeAttachmentScenario-75865889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:47:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-03da72dc-0995-4c28-9783-50594cb214c7 tempest-TestServerVolumeAttachmentScenario-75865889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:47:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-03da72dc-0995-4c28-9783-50594cb214c7 tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-03da72dc-0995-4c28-9783-50594cb214c7 tempest-TestServerVolumeAttachmentScenario-75865889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:38 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:47:38 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:38 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e739d3f-5605-4c4b-a713-7f92217091eb Nov 06 18:47:38 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4a40a3e5-8969-467b-bdc5-b9191709e5bd tempest-TestServerVolumeAttachmentScenario-75865889 None] Acquiring lock "cinder-4a2e8a54-a6cf-463c-88db-14b12a17bf4f-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4a40a3e5-8969-467b-bdc5-b9191709e5bd tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "cinder-4a2e8a54-a6cf-463c-88db-14b12a17bf4f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4a40a3e5-8969-467b-bdc5-b9191709e5bd tempest-TestServerVolumeAttachmentScenario-75865889 None] Acquiring lock "cinder-quobyte-4a2e8a54-a6cf-463c-88db-14b12a17bf4f" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:39 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4a40a3e5-8969-467b-bdc5-b9191709e5bd tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "cinder-quobyte-4a2e8a54-a6cf-463c-88db-14b12a17bf4f" acquired by "delete_volume" :: waited 0.030s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-03da72dc-0995-4c28-9783-50594cb214c7 tempest-TestServerVolumeAttachmentScenario-75865889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.337s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-03da72dc-0995-4c28-9783-50594cb214c7 tempest-TestServerVolumeAttachmentScenario-75865889 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:47:39 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-03da72dc-0995-4c28-9783-50594cb214c7 tempest-TestServerVolumeAttachmentScenario-75865889 None] Deleted volume successfully. Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4dca79-1288-4ecf-be5a-7f6b3cd55ff7]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4a40a3e5-8969-467b-bdc5-b9191709e5bd tempest-TestServerVolumeAttachmentScenario-75865889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4a2e8a54-a6cf-463c-88db-14b12a17bf4f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:39 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94ba29ae-f21c-479f-9192-0c42b834c0b6 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e739d3f-5605-4c4b-a713-7f92217091eb" returned: 0 in 0.431s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94ba29ae-f21c-479f-9192-0c42b834c0b6 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e739d3f-5605-4c4b-a713-7f92217091eb {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-03da72dc-0995-4c28-9783-50594cb214c7 tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "cinder-c24ad99e-2255-4a99-85a1-33e277c432af-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:39 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e739d3f-5605-4c4b-a713-7f92217091eb Nov 06 18:47:39 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:39 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4a2e8a54-a6cf-463c-88db-14b12a17bf4f Nov 06 18:47:39 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:39 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94ba29ae-f21c-479f-9192-0c42b834c0b6 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0e739d3f-5605-4c4b-a713-7f92217091eb" returned: 0 in 0.334s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-94ba29ae-f21c-479f-9192-0c42b834c0b6 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-0e739d3f-5605-4c4b-a713-7f92217091eb" released by "delete_volume" :: held 0.831s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:39 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4a40a3e5-8969-467b-bdc5-b9191709e5bd tempest-TestServerVolumeAttachmentScenario-75865889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4a2e8a54-a6cf-463c-88db-14b12a17bf4f" returned: 0 in 0.461s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4a40a3e5-8969-467b-bdc5-b9191709e5bd tempest-TestServerVolumeAttachmentScenario-75865889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4a2e8a54-a6cf-463c-88db-14b12a17bf4f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-94ba29ae-f21c-479f-9192-0c42b834c0b6 tempest-VolumesSnapshotTestJSON-988246926 None] Created reservations ['e882484f-b352-4762-9d8a-cbd34edb3d28', '20b18ffa-9c35-4fca-8571-fb15664294cb', 'f2838f81-5ba1-418e-b825-f9ab6fb52faa', '3740edde-cccd-43ff-a02e-669dea905897'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:47:39 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4a2e8a54-a6cf-463c-88db-14b12a17bf4f Nov 06 18:47:39 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-94ba29ae-f21c-479f-9192-0c42b834c0b6 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-94ba29ae-f21c-479f-9192-0c42b834c0b6 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-94ba29ae-f21c-479f-9192-0c42b834c0b6 tempest-VolumesSnapshotTestJSON-988246926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-94ba29ae-f21c-479f-9192-0c42b834c0b6 tempest-VolumesSnapshotTestJSON-988246926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-94ba29ae-f21c-479f-9192-0c42b834c0b6 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94ba29ae-f21c-479f-9192-0c42b834c0b6 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:39 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:47:39 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-073c07ad-0740-42f6-98eb-65fea61d3cf0-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-073c07ad-0740-42f6-98eb-65fea61d3cf0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-quobyte-984c1110-10cf-43af-9cdd-1189111b3a2a" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-984c1110-10cf-43af-9cdd-1189111b3a2a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-quobyte-073c07ad-0740-42f6-98eb-65fea61d3cf0" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:40 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4a40a3e5-8969-467b-bdc5-b9191709e5bd tempest-TestServerVolumeAttachmentScenario-75865889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4a2e8a54-a6cf-463c-88db-14b12a17bf4f" returned: 0 in 0.374s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-073c07ad-0740-42f6-98eb-65fea61d3cf0" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] Deleting offline snapshot 073c07ad-0740-42f6-98eb-65fea61d3cf0 of volume 984c1110-10cf-43af-9cdd-1189111b3a2a {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] snapshot_file for this snap is: volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4a40a3e5-8969-467b-bdc5-b9191709e5bd tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "cinder-quobyte-4a2e8a54-a6cf-463c-88db-14b12a17bf4f" released by "delete_volume" :: held 1.016s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd22bd31-27d7-4ef4-b0ad-175e19426e6b]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-4a40a3e5-8969-467b-bdc5-b9191709e5bd tempest-TestServerVolumeAttachmentScenario-75865889 None] Created reservations ['0120a8ff-f655-4282-a40d-d2154477be42', '3a250e94-fd72-4b81-a628-da3f0d46930c', 'cc740562-21b3-475d-82d1-e51778759d48', '6d8d1ba8-3967-4406-aa14-62c546f6a3eb'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:47:40 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0 Nov 06 18:47:40 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:40 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94ba29ae-f21c-479f-9192-0c42b834c0b6 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.594s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-94ba29ae-f21c-479f-9192-0c42b834c0b6 tempest-VolumesSnapshotTestJSON-988246926 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:47:40 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-94ba29ae-f21c-479f-9192-0c42b834c0b6 tempest-VolumesSnapshotTestJSON-988246926 None] Deleted volume successfully. Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4a40a3e5-8969-467b-bdc5-b9191709e5bd tempest-TestServerVolumeAttachmentScenario-75865889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4a40a3e5-8969-467b-bdc5-b9191709e5bd tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4a40a3e5-8969-467b-bdc5-b9191709e5bd tempest-TestServerVolumeAttachmentScenario-75865889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4a40a3e5-8969-467b-bdc5-b9191709e5bd tempest-TestServerVolumeAttachmentScenario-75865889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4a40a3e5-8969-467b-bdc5-b9191709e5bd tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4a40a3e5-8969-467b-bdc5-b9191709e5bd tempest-TestServerVolumeAttachmentScenario-75865889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-94ba29ae-f21c-479f-9192-0c42b834c0b6 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-0e739d3f-5605-4c4b-a713-7f92217091eb-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:40 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:47:40 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:40 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0" returned: 0 in 0.547s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-984c1110-10cf-43af-9cdd-1189111b3a2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f5b087-6e4b-45aa-b4d3-5bd679cf2280]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:40 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4a40a3e5-8969-467b-bdc5-b9191709e5bd tempest-TestServerVolumeAttachmentScenario-75865889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.337s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-4a40a3e5-8969-467b-bdc5-b9191709e5bd tempest-TestServerVolumeAttachmentScenario-75865889 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:47:40 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-4a40a3e5-8969-467b-bdc5-b9191709e5bd tempest-TestServerVolumeAttachmentScenario-75865889 None] Deleted volume successfully. Nov 06 18:47:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4a40a3e5-8969-467b-bdc5-b9191709e5bd tempest-TestServerVolumeAttachmentScenario-75865889 None] Lock "cinder-4a2e8a54-a6cf-463c-88db-14b12a17bf4f-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:40 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a Nov 06 18:47:40 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:41 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d25c618f-0c95-4196-a591-39a009f406a5 tempest-TestShelveInstance-493342226 None] Terminate volume connection completed successfully. Nov 06 18:47:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d25c618f-0c95-4196-a591-39a009f406a5 tempest-TestShelveInstance-493342226 None] Deleting attachment 74d10f88-22d4-4d26-9e85-6c950dcbdafa. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:47:41 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a" returned: 0 in 0.763s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:41 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0 Nov 06 18:47:41 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d44104f8-14ea-4147-bf14-28bb8f610eb2 tempest-TestShelveInstance-493342226 None] Acquiring lock "cinder-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d44104f8-14ea-4147-bf14-28bb8f610eb2 tempest-TestShelveInstance-493342226 None] Lock "cinder-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d44104f8-14ea-4147-bf14-28bb8f610eb2 tempest-TestShelveInstance-493342226 None] Acquiring lock "cinder-quobyte-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d44104f8-14ea-4147-bf14-28bb8f610eb2 tempest-TestShelveInstance-493342226 None] Lock "cinder-quobyte-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd" acquired by "delete_volume" :: waited 0.017s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:41 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b120ba-9fe5-4b25-9441-85686079f7a4]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d44104f8-14ea-4147-bf14-28bb8f610eb2 tempest-TestShelveInstance-493342226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:42 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd Nov 06 18:47:42 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:42 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0" returned: 0 in 0.458s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:42 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0 Nov 06 18:47:42 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:42 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a.073c07ad-0740-42f6-98eb-65fea61d3cf0" returned: 0 in 0.291s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:42 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d44104f8-14ea-4147-bf14-28bb8f610eb2 tempest-TestShelveInstance-493342226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd" returned: 0 in 0.527s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d44104f8-14ea-4147-bf14-28bb8f610eb2 tempest-TestShelveInstance-493342226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-073c07ad-0740-42f6-98eb-65fea61d3cf0" released by "_delete_snapshot" :: held 2.298s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-984c1110-10cf-43af-9cdd-1189111b3a2a" released by "delete_snapshot" :: held 2.353s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:42 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd Nov 06 18:47:42 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:42 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] Created reservations ['bc7e0cca-1b97-477b-9aa0-d29a72603306', '60f7cf80-2324-4739-a0be-87bae41f0b05', 'd39172c3-cbd9-492a-b75e-7b1b98b67f9b', '133be447-7785-49f6-9ddc-49fd308cb35b'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:47:42 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] Delete snapshot completed successfully. Nov 06 18:47:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c88bdf28-71f2-4411-9ae2-7b83858556ba tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-073c07ad-0740-42f6-98eb-65fea61d3cf0-delete_snapshot" released by "delete_snapshot" :: held 2.543s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:42 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d44104f8-14ea-4147-bf14-28bb8f610eb2 tempest-TestShelveInstance-493342226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd" returned: 0 in 0.349s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d44104f8-14ea-4147-bf14-28bb8f610eb2 tempest-TestShelveInstance-493342226 None] Lock "cinder-quobyte-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd" released by "delete_volume" :: held 0.937s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:42 devstack cinder-volume[86794]: DEBUG cinder.quota [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d44104f8-14ea-4147-bf14-28bb8f610eb2 tempest-TestShelveInstance-493342226 None] Created reservations ['7d49746e-6d65-4309-a4c7-728c9f5d57b7', 'a4e60a54-726a-480d-8213-bdea87aff789', 'd04b30b6-4418-4ea3-946d-483157627403', 'b45229b8-401c-479a-b317-4741892f7b51'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:47:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d44104f8-14ea-4147-bf14-28bb8f610eb2 tempest-TestShelveInstance-493342226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d44104f8-14ea-4147-bf14-28bb8f610eb2 tempest-TestShelveInstance-493342226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d44104f8-14ea-4147-bf14-28bb8f610eb2 tempest-TestShelveInstance-493342226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:47:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d44104f8-14ea-4147-bf14-28bb8f610eb2 tempest-TestShelveInstance-493342226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:47:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d44104f8-14ea-4147-bf14-28bb8f610eb2 tempest-TestShelveInstance-493342226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d44104f8-14ea-4147-bf14-28bb8f610eb2 tempest-TestShelveInstance-493342226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:42 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:47:42 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:43 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d44104f8-14ea-4147-bf14-28bb8f610eb2 tempest-TestShelveInstance-493342226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.277s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:43 devstack cinder-volume[86794]: DEBUG cinder.manager [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d44104f8-14ea-4147-bf14-28bb8f610eb2 tempest-TestShelveInstance-493342226 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:47:43 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d44104f8-14ea-4147-bf14-28bb8f610eb2 tempest-TestShelveInstance-493342226 None] Deleted volume successfully. Nov 06 18:47:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [req-3de8b438-680c-4468-87ff-d7bb1b3667b1 req-d44104f8-14ea-4147-bf14-28bb8f610eb2 tempest-TestShelveInstance-493342226 None] Lock "cinder-69842e92-0cdd-48c2-a98f-2ca2d89bc3dd-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3afc3bb8-cd50-45f0-accb-40c6ddfca2f0 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-984c1110-10cf-43af-9cdd-1189111b3a2a-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3afc3bb8-cd50-45f0-accb-40c6ddfca2f0 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-984c1110-10cf-43af-9cdd-1189111b3a2a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3afc3bb8-cd50-45f0-accb-40c6ddfca2f0 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-quobyte-984c1110-10cf-43af-9cdd-1189111b3a2a" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3afc3bb8-cd50-45f0-accb-40c6ddfca2f0 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-984c1110-10cf-43af-9cdd-1189111b3a2a" acquired by "delete_volume" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:43 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7450c759-4497-4c5f-8e55-cc66ae17003f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3afc3bb8-cd50-45f0-accb-40c6ddfca2f0 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:43 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a Nov 06 18:47:43 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:43 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3afc3bb8-cd50-45f0-accb-40c6ddfca2f0 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a" returned: 0 in 0.430s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3afc3bb8-cd50-45f0-accb-40c6ddfca2f0 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:44 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a Nov 06 18:47:44 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:44 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3afc3bb8-cd50-45f0-accb-40c6ddfca2f0 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-984c1110-10cf-43af-9cdd-1189111b3a2a" returned: 0 in 0.264s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3afc3bb8-cd50-45f0-accb-40c6ddfca2f0 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-984c1110-10cf-43af-9cdd-1189111b3a2a" released by "delete_volume" :: held 0.779s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:44 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-3afc3bb8-cd50-45f0-accb-40c6ddfca2f0 tempest-VolumesSnapshotTestJSON-988246926 None] Created reservations ['497f0953-7de5-4100-a019-9fd25debbdb3', 'ab3da13b-5fee-4330-ad2c-a7d4a203589f', 'b2c505c8-95e4-423d-808d-359ef544f426', '992ce726-534e-40b4-a2a4-cc278226cc59'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:47:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3afc3bb8-cd50-45f0-accb-40c6ddfca2f0 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3afc3bb8-cd50-45f0-accb-40c6ddfca2f0 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3afc3bb8-cd50-45f0-accb-40c6ddfca2f0 tempest-VolumesSnapshotTestJSON-988246926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:47:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3afc3bb8-cd50-45f0-accb-40c6ddfca2f0 tempest-VolumesSnapshotTestJSON-988246926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:47:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3afc3bb8-cd50-45f0-accb-40c6ddfca2f0 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3afc3bb8-cd50-45f0-accb-40c6ddfca2f0 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:44 devstack sudo[103940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:47:44 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d0b546ed-ca48-4464-bd59-ca6d639c2d53 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-3d7effc2-867e-4ba1-b871-14c6452c1e81-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d0b546ed-ca48-4464-bd59-ca6d639c2d53 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-3d7effc2-867e-4ba1-b871-14c6452c1e81-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d0b546ed-ca48-4464-bd59-ca6d639c2d53 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "cinder-quobyte-3d7effc2-867e-4ba1-b871-14c6452c1e81" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:47:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d0b546ed-ca48-4464-bd59-ca6d639c2d53 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-3d7effc2-867e-4ba1-b871-14c6452c1e81" acquired by "delete_volume" :: waited 0.016s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:47:44 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3afc3bb8-cd50-45f0-accb-40c6ddfca2f0 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.442s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:44 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-3afc3bb8-cd50-45f0-accb-40c6ddfca2f0 tempest-VolumesSnapshotTestJSON-988246926 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:47:44 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-3afc3bb8-cd50-45f0-accb-40c6ddfca2f0 tempest-VolumesSnapshotTestJSON-988246926 None] Deleted volume successfully. Nov 06 18:47:44 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc8e0c4-974a-450b-97f2-9dbcf46e155a]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:47:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d0b546ed-ca48-4464-bd59-ca6d639c2d53 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3afc3bb8-cd50-45f0-accb-40c6ddfca2f0 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-984c1110-10cf-43af-9cdd-1189111b3a2a-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:44 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81 Nov 06 18:47:44 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:45 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d0b546ed-ca48-4464-bd59-ca6d639c2d53 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81" returned: 0 in 0.363s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d0b546ed-ca48-4464-bd59-ca6d639c2d53 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:45 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81 Nov 06 18:47:45 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:45 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d0b546ed-ca48-4464-bd59-ca6d639c2d53 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3d7effc2-867e-4ba1-b871-14c6452c1e81" returned: 0 in 0.268s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d0b546ed-ca48-4464-bd59-ca6d639c2d53 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-quobyte-3d7effc2-867e-4ba1-b871-14c6452c1e81" released by "delete_volume" :: held 0.717s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:45 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-d0b546ed-ca48-4464-bd59-ca6d639c2d53 tempest-VolumesSnapshotTestJSON-988246926 None] Created reservations ['309b91f8-d0de-47f8-b317-5e85a9342950', '0982f99a-1a8e-4578-9a38-fc6e10d464c8', '4c0ab2e7-3a29-4946-a994-587ed41a507a', '91aabc69-bc01-4f6c-8aa1-0840c7ad69af'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:47:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d0b546ed-ca48-4464-bd59-ca6d639c2d53 tempest-VolumesSnapshotTestJSON-988246926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:47:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d0b546ed-ca48-4464-bd59-ca6d639c2d53 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:47:45 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d0b546ed-ca48-4464-bd59-ca6d639c2d53 tempest-VolumesSnapshotTestJSON-988246926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:47:45 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d0b546ed-ca48-4464-bd59-ca6d639c2d53 tempest-VolumesSnapshotTestJSON-988246926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:47:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d0b546ed-ca48-4464-bd59-ca6d639c2d53 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:47:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d0b546ed-ca48-4464-bd59-ca6d639c2d53 tempest-VolumesSnapshotTestJSON-988246926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:47:45 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:47:45 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:47:46 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Nov 06 18:47:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d0b546ed-ca48-4464-bd59-ca6d639c2d53 tempest-VolumesSnapshotTestJSON-988246926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.332s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:47:46 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-d0b546ed-ca48-4464-bd59-ca6d639c2d53 tempest-VolumesSnapshotTestJSON-988246926 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:47:46 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-d0b546ed-ca48-4464-bd59-ca6d639c2d53 tempest-VolumesSnapshotTestJSON-988246926 None] Deleted volume successfully. Nov 06 18:47:46 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d0b546ed-ca48-4464-bd59-ca6d639c2d53 tempest-VolumesSnapshotTestJSON-988246926 None] Lock "cinder-3d7effc2-867e-4ba1-b871-14c6452c1e81-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:47:55 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=114,cinder:UPDATE=126,cinder:INSERT=24,cinder:DELETE=6 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:47:56 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=97,cinder:UPDATE=111,cinder:DELETE=12,cinder:INSERT=36 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:48:00 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:48:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Flow 'volume_create_manager' (fb443429-dc44-4e8b-8835-0a99d30ce78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:48:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893ce9d0-5542-465b-8eab-7e40017c6220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893ce9d0-5542-465b-8eab-7e40017c6220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4119df-f364-4d43-9eab-90099a9e05f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5dae35d48ca4b659afe704b2c6a1323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:48:00Z,use_quota=True,user_id='d55bc5b26b26404a86aec9a4290cef98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67c5e1de-fe8d-41fa-8f85-3c39a05aed02),volume_type_id=67c5e1de-fe8d-41fa-8f85-3c39a05aed02)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b7e60a-9c4e-4fec-8c0f-0ab385d0be61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b7e60a-9c4e-4fec-8c0f-0ab385d0be61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa89aa5-bb24-478d-b669-5ca1d3286ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:00 devstack cinder-volume[86794]: DEBUG cinder.image.glance [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Creating Keystone auth plugin from conf {{(pid=86794) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 18:48:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa89aa5-bb24-478d-b669-5ca1d3286ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae4119df-f364-4d43-9eab-90099a9e05f3', 'volume_name': 'volume-ae4119df-f364-4d43-9eab-90099a9e05f3', 'volume_size': 1, 'image_id': '083c5581-444a-485f-9bbe-885239f6fa69', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/083c5581-444a-485f-9bbe-885239f6fa69', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '242ff21243166a437774e84b9d9d8482', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c5dae35d48ca4b659afe704b2c6a1323', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '86f8916489e8c3c1835b544364d157505afb99daa8aca142409821a5317611b16793a12df1579a447143a3d9768081bcd49d06cbfbd473a5376bb4dce26f1277', 'id': '083c5581-444a-485f-9bbe-885239f6fa69', 'created_at': datetime.datetime(2026, 11, 6, 17, 47, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 47, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/083c5581-444a-485f-9bbe-885239f6fa69/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39acb5b9-7db5-4aa4-8359-1940c9b867e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39acb5b9-7db5-4aa4-8359-1940c9b867e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85918787-e2cd-4c1b-8755-7c892a2365d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:00 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Volume ae4119df-f364-4d43-9eab-90099a9e05f3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae4119df-f364-4d43-9eab-90099a9e05f3', 'volume_size': 1, 'image_id': '083c5581-444a-485f-9bbe-885239f6fa69', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/083c5581-444a-485f-9bbe-885239f6fa69', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '242ff21243166a437774e84b9d9d8482', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c5dae35d48ca4b659afe704b2c6a1323', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '86f8916489e8c3c1835b544364d157505afb99daa8aca142409821a5317611b16793a12df1579a447143a3d9768081bcd49d06cbfbd473a5376bb4dce26f1277', 'id': '083c5581-444a-485f-9bbe-885239f6fa69', 'created_at': datetime.datetime(2026, 11, 6, 17, 47, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 47, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/083c5581-444a-485f-9bbe-885239f6fa69/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 18:48:00 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Trying to clone ae4119df-f364-4d43-9eab-90099a9e05f3 from image 083c5581-444a-485f-9bbe-885239f6fa69 at location (None, [{'url': 'file:///opt/stack/data/glance/images/083c5581-444a-485f-9bbe-885239f6fa69', 'metadata': {}}]). {{(pid=86794) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 18:48:00 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 18:48:00 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Image download 0.00 MB at 0.00 MB/s Nov 06 18:48:00 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed3118d-1de1-4332-9019-d923823f5a7b]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:48:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:00 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD Nov 06 18:48:00 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:01 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:01 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD Nov 06 18:48:01 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:01 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD" returned: 1 in 0.414s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:48:01 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Temporary image 083c5581-444a-485f-9bbe-885239f6fa69 is fetched for user d55bc5b26b26404a86aec9a4290cef98. {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 18:48:01 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2a3a9a-dbed-4958-bff7-900da12fa23b]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:48:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:01 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD Nov 06 18:48:01 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:02 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD" returned: 0 in 0.485s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:02 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD Nov 06 18:48:02 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:02 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:48:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:48:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:48:02 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4119df-f364-4d43-9eab-90099a9e05f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5dae35d48ca4b659afe704b2c6a1323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:48:00Z,use_quota=True,user_id='d55bc5b26b26404a86aec9a4290cef98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67c5e1de-fe8d-41fa-8f85-3c39a05aed02),volume_type_id=67c5e1de-fe8d-41fa-8f85-3c39a05aed02)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:48:02 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Creating volume ae4119df-f364-4d43-9eab-90099a9e05f3 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:48:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:48:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:48:02 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:48:02 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:48:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:48:02 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:48:02 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:48:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ae4119df-f364-4d43-9eab-90099a9e05f3 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:02 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ae4119df-f364-4d43-9eab-90099a9e05f3 1073741824 Nov 06 18:48:02 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:03 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ae4119df-f364-4d43-9eab-90099a9e05f3 1073741824" returned: 0 in 0.558s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ae4119df-f364-4d43-9eab-90099a9e05f3 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:03 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ae4119df-f364-4d43-9eab-90099a9e05f3 Nov 06 18:48:03 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:03 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ae4119df-f364-4d43-9eab-90099a9e05f3" returned: 0 in 0.265s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:48:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:48:03 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Attempting download of 083c5581-444a-485f-9bbe-885239f6fa69 ((None, [{'url': 'file:///opt/stack/data/glance/images/083c5581-444a-485f-9bbe-885239f6fa69', 'metadata': {}}])) to volume ae4119df-f364-4d43-9eab-90099a9e05f3. {{(pid=86794) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 18:48:03 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4b7903-807e-467f-a7e9-572f0729e521]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:48:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_083c5581-444a-485f-9bbe-885239f6fa69_v_l_mwb8 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:03 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_083c5581-444a-485f-9bbe-885239f6fa69_v_l_mwb8 Nov 06 18:48:03 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:03 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_083c5581-444a-485f-9bbe-885239f6fa69_v_l_mwb8" returned: 0 in 0.341s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_083c5581-444a-485f-9bbe-885239f6fa69_v_l_mwb8 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:03 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_083c5581-444a-485f-9bbe-885239f6fa69_v_l_mwb8 Nov 06 18:48:03 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:04 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_083c5581-444a-485f-9bbe-885239f6fa69_v_l_mwb8" returned: 1 in 0.368s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_083c5581-444a-485f-9bbe-885239f6fa69_v_l_mwb8' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:48:04 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ffb710-5cde-41e1-abac-7fd58db6bb82]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:48:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:04 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD Nov 06 18:48:04 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:04 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:04 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD Nov 06 18:48:04 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:05 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD" returned: 1 in 0.404s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:48:05 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] 083c5581-444a-485f-9bbe-885239f6fa69 was raw, converting to qcow2 {{(pid=86794) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 18:48:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ae4119df-f364-4d43-9eab-90099a9e05f3 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:05 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ae4119df-f364-4d43-9eab-90099a9e05f3 Nov 06 18:48:05 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:05 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ae4119df-f364-4d43-9eab-90099a9e05f3" returned: 0 in 0.578s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:05 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_083c5581-444a-485f-9bbe-885239f6fa69_z0xkrtfhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ae4119df-f364-4d43-9eab-90099a9e05f3 {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:48:05 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 18:48:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ae4119df-f364-4d43-9eab-90099a9e05f3 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:05 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ae4119df-f364-4d43-9eab-90099a9e05f3 1G Nov 06 18:48:05 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:06 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ae4119df-f364-4d43-9eab-90099a9e05f3 1G" returned: 0 in 0.365s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:06 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Downloaded image 083c5581-444a-485f-9bbe-885239f6fa69 ((None, [{'url': 'file:///opt/stack/data/glance/images/083c5581-444a-485f-9bbe-885239f6fa69', 'metadata': {}}])) to volume ae4119df-f364-4d43-9eab-90099a9e05f3 successfully. {{(pid=86794) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 18:48:06 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Temporary image 083c5581-444a-485f-9bbe-885239f6fa69 for user d55bc5b26b26404a86aec9a4290cef98 is deleted. {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 18:48:06 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Marking volume ae4119df-f364-4d43-9eab-90099a9e05f3 as bootable. {{(pid=86794) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 18:48:06 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Copying metadata from image 083c5581-444a-485f-9bbe-885239f6fa69 to ae4119df-f364-4d43-9eab-90099a9e05f3. {{(pid=86794) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 18:48:06 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Creating volume glance metadata for volume ae4119df-f364-4d43-9eab-90099a9e05f3 backed by image 083c5581-444a-485f-9bbe-885239f6fa69 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '083c5581-444a-485f-9bbe-885239f6fa69', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '242ff21243166a437774e84b9d9d8482', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86794) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 18:48:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85918787-e2cd-4c1b-8755-7c892a2365d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae4119df-f364-4d43-9eab-90099a9e05f3', 'volume_size': 1, 'image_id': '083c5581-444a-485f-9bbe-885239f6fa69', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/083c5581-444a-485f-9bbe-885239f6fa69', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '242ff21243166a437774e84b9d9d8482', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c5dae35d48ca4b659afe704b2c6a1323', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '86f8916489e8c3c1835b544364d157505afb99daa8aca142409821a5317611b16793a12df1579a447143a3d9768081bcd49d06cbfbd473a5376bb4dce26f1277', 'id': '083c5581-444a-485f-9bbe-885239f6fa69', 'created_at': datetime.datetime(2026, 11, 6, 17, 47, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 47, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/083c5581-444a-485f-9bbe-885239f6fa69/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d44b4e7-61f0-4a20-8e5d-eeb837b32687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:06 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Volume volume-ae4119df-f364-4d43-9eab-90099a9e05f3 (ae4119df-f364-4d43-9eab-90099a9e05f3): created successfully Nov 06 18:48:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d44b4e7-61f0-4a20-8e5d-eeb837b32687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Flow 'volume_create_manager' (fb443429-dc44-4e8b-8835-0a99d30ce78b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:48:06 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-58f492af-25f7-4b6e-8868-d366afec9e8b tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Created volume successfully. Nov 06 18:48:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Acquiring lock "cinder-ae4119df-f364-4d43-9eab-90099a9e05f3-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:48:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Lock "cinder-ae4119df-f364-4d43-9eab-90099a9e05f3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:48:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Acquiring lock "cinder-quobyte-ae4119df-f364-4d43-9eab-90099a9e05f3" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:48:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Lock "cinder-quobyte-ae4119df-f364-4d43-9eab-90099a9e05f3" acquired by "delete_volume" :: waited 0.018s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:48:06 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39aa298-67f8-4d0c-9504-d97e1e0b3f33]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:48:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ae4119df-f364-4d43-9eab-90099a9e05f3 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:06 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ae4119df-f364-4d43-9eab-90099a9e05f3 Nov 06 18:48:06 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:07 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ae4119df-f364-4d43-9eab-90099a9e05f3" returned: 0 in 0.436s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ae4119df-f364-4d43-9eab-90099a9e05f3 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:07 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ae4119df-f364-4d43-9eab-90099a9e05f3 Nov 06 18:48:07 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:07 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ae4119df-f364-4d43-9eab-90099a9e05f3" returned: 0 in 0.303s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:07 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Lock "cinder-quobyte-ae4119df-f364-4d43-9eab-90099a9e05f3" released by "delete_volume" :: held 0.803s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:48:07 devstack cinder-volume[86794]: WARNING cinder.quota [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:48:07 devstack cinder-volume[86794]: WARNING cinder.quota [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:48:07 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Created reservations ['dd34a362-0ce8-442a-8fe8-9824f5af2569', 'af95007b-ea17-4bf4-a321-ecc0fb468cac', '1c3cb83c-63ed-464c-9e14-69ca6454cc7e', '6ad091ab-3b78-4493-a54a-38d15ef51e27'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:48:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:48:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:48:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:48:07 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:48:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:48:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:07 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:48:07 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:08 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.334s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:08 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:48:08 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Deleted volume successfully. Nov 06 18:48:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e485a820-649c-4c42-b6a4-aec29c9023d2 tempest-VolumeAndVolumeTypeFromImageTest-388949138 None] Lock "cinder-ae4119df-f364-4d43-9eab-90099a9e05f3-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:48:17 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=12,cinder:UPDATE=9,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:48:18 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=14,cinder:INSERT=7,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:48:19 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:48:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Flow 'volume_create_manager' (32cecd49-118e-466e-a70c-84ee896e3f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f251a3e2-384b-41da-a38b-4fb254b02134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f251a3e2-384b-41da-a38b-4fb254b02134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2094877717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1849628-c1ec-4820-833e-4b865b8a7d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17b0c43f71ef416f8f5c112d34d1f86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:48:20Z,use_quota=True,user_id='ca3d02bd757f422b89f8860bc84f120c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4cd6f0-ae20-48d1-b3f2-1b2683da5179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4cd6f0-ae20-48d1-b3f2-1b2683da5179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e069f5f7-2f97-4617-ac18-c438aaaac3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e069f5f7-2f97-4617-ac18-c438aaaac3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1849628-c1ec-4820-833e-4b865b8a7d5c', 'volume_name': 'volume-e1849628-c1ec-4820-833e-4b865b8a7d5c', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b76702-db09-487c-a00d-69f9cf7cee4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b76702-db09-487c-a00d-69f9cf7cee4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831f115f-0864-4591-a9da-8372d7bbcd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:20 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Volume e1849628-c1ec-4820-833e-4b865b8a7d5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1849628-c1ec-4820-833e-4b865b8a7d5c', 'volume_size': 1} Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2094877717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1849628-c1ec-4820-833e-4b865b8a7d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17b0c43f71ef416f8f5c112d34d1f86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:48:20Z,use_quota=True,user_id='ca3d02bd757f422b89f8860bc84f120c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Creating volume e1849628-c1ec-4820-833e-4b865b8a7d5c {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:48:20 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e1849628-c1ec-4820-833e-4b865b8a7d5c 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:20 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e1849628-c1ec-4820-833e-4b865b8a7d5c 1073741824 Nov 06 18:48:20 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:20 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e1849628-c1ec-4820-833e-4b865b8a7d5c 1073741824" returned: 0 in 0.612s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e1849628-c1ec-4820-833e-4b865b8a7d5c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:20 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e1849628-c1ec-4820-833e-4b865b8a7d5c Nov 06 18:48:20 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:21 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e1849628-c1ec-4820-833e-4b865b8a7d5c" returned: 0 in 0.277s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:48:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:48:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831f115f-0864-4591-a9da-8372d7bbcd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1849628-c1ec-4820-833e-4b865b8a7d5c', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db78473c-a248-4f64-b2bd-5396e0151a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:21 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Volume volume-e1849628-c1ec-4820-833e-4b865b8a7d5c (e1849628-c1ec-4820-833e-4b865b8a7d5c): created successfully Nov 06 18:48:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db78473c-a248-4f64-b2bd-5396e0151a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Flow 'volume_create_manager' (32cecd49-118e-466e-a70c-84ee896e3f4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:48:21 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-18a5e1db-ed31-49ef-b4c6-e72356c0c3f8 tempest-ProjectReaderTests-239819983 None] Created volume successfully. Nov 06 18:48:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-14d56495-f01c-4e18-9ddb-791a7faf4214 tempest-ProjectReaderTests-239819983 None] Acquiring lock "cinder-e1849628-c1ec-4820-833e-4b865b8a7d5c-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:48:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-14d56495-f01c-4e18-9ddb-791a7faf4214 tempest-ProjectReaderTests-239819983 None] Lock "cinder-e1849628-c1ec-4820-833e-4b865b8a7d5c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:48:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-14d56495-f01c-4e18-9ddb-791a7faf4214 tempest-ProjectReaderTests-239819983 None] Acquiring lock "cinder-quobyte-e1849628-c1ec-4820-833e-4b865b8a7d5c" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:48:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-14d56495-f01c-4e18-9ddb-791a7faf4214 tempest-ProjectReaderTests-239819983 None] Lock "cinder-quobyte-e1849628-c1ec-4820-833e-4b865b8a7d5c" acquired by "delete_volume" :: waited 0.024s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:48:22 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d3f64a-b126-4ba6-a2c9-f0fa14f90bbf]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:48:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-14d56495-f01c-4e18-9ddb-791a7faf4214 tempest-ProjectReaderTests-239819983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e1849628-c1ec-4820-833e-4b865b8a7d5c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:22 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e1849628-c1ec-4820-833e-4b865b8a7d5c Nov 06 18:48:22 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:22 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-14d56495-f01c-4e18-9ddb-791a7faf4214 tempest-ProjectReaderTests-239819983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e1849628-c1ec-4820-833e-4b865b8a7d5c" returned: 0 in 0.437s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-14d56495-f01c-4e18-9ddb-791a7faf4214 tempest-ProjectReaderTests-239819983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e1849628-c1ec-4820-833e-4b865b8a7d5c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:22 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e1849628-c1ec-4820-833e-4b865b8a7d5c Nov 06 18:48:22 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:23 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-14d56495-f01c-4e18-9ddb-791a7faf4214 tempest-ProjectReaderTests-239819983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e1849628-c1ec-4820-833e-4b865b8a7d5c" returned: 0 in 0.312s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-14d56495-f01c-4e18-9ddb-791a7faf4214 tempest-ProjectReaderTests-239819983 None] Lock "cinder-quobyte-e1849628-c1ec-4820-833e-4b865b8a7d5c" released by "delete_volume" :: held 0.811s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:48:23 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-14d56495-f01c-4e18-9ddb-791a7faf4214 tempest-ProjectReaderTests-239819983 None] Created reservations ['91e873e0-3c11-4d90-bdf9-492e3a7e6104', 'f7df886b-0e89-40fc-b37c-0fba31cdec8c', 'ad274367-a6f3-4f95-ae57-9a5dfb7068ef', '64cfb618-f777-4a43-8411-b3cf484ba73b'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:48:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-14d56495-f01c-4e18-9ddb-791a7faf4214 tempest-ProjectReaderTests-239819983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:48:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-14d56495-f01c-4e18-9ddb-791a7faf4214 tempest-ProjectReaderTests-239819983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:48:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-14d56495-f01c-4e18-9ddb-791a7faf4214 tempest-ProjectReaderTests-239819983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:48:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-14d56495-f01c-4e18-9ddb-791a7faf4214 tempest-ProjectReaderTests-239819983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:48:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-14d56495-f01c-4e18-9ddb-791a7faf4214 tempest-ProjectReaderTests-239819983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:48:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-14d56495-f01c-4e18-9ddb-791a7faf4214 tempest-ProjectReaderTests-239819983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:23 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:48:23 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:23 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-14d56495-f01c-4e18-9ddb-791a7faf4214 tempest-ProjectReaderTests-239819983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.421s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:23 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-14d56495-f01c-4e18-9ddb-791a7faf4214 tempest-ProjectReaderTests-239819983 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:48:23 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-14d56495-f01c-4e18-9ddb-791a7faf4214 tempest-ProjectReaderTests-239819983 None] Deleted volume successfully. Nov 06 18:48:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-14d56495-f01c-4e18-9ddb-791a7faf4214 tempest-ProjectReaderTests-239819983 None] Lock "cinder-e1849628-c1ec-4820-833e-4b865b8a7d5c-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Flow 'volume_create_manager' (7073b822-7e23-48a5-8f4c-2b5f3fe78829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106f88f3-5a50-47b6-9756-8963557763b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106f88f3-5a50-47b6-9756-8963557763b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1604620699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c261d1-2104-4cb4-9c3f-040e5a1d4100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2bade420ef54b6bb95772c2a35c0c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:48:24Z,use_quota=True,user_id='835cf9aef26f4c2d8b11a30c5da4669b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e07c717a-d5c7-43a3-a85b-4caa226a987d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e07c717a-d5c7-43a3-a85b-4caa226a987d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb485cae-af64-4f2e-9eb2-ca21b8968090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb485cae-af64-4f2e-9eb2-ca21b8968090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58c261d1-2104-4cb4-9c3f-040e5a1d4100', 'volume_name': 'volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c016cb50-f2b5-433a-b61a-2d9fe3c3d89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c016cb50-f2b5-433a-b61a-2d9fe3c3d89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (634b18cf-8923-4d97-bceb-36136e0902ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:24 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Volume 58c261d1-2104-4cb4-9c3f-040e5a1d4100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100', 'volume_size': 1} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1604620699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c261d1-2104-4cb4-9c3f-040e5a1d4100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2bade420ef54b6bb95772c2a35c0c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:48:24Z,use_quota=True,user_id='835cf9aef26f4c2d8b11a30c5da4669b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Creating volume 58c261d1-2104-4cb4-9c3f-040e5a1d4100 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:48:24 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:24 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100 1073741824 Nov 06 18:48:24 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Flow 'volume_create_manager' (df67b39d-c92f-4d7a-b23f-7207314f5844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63f6636-e810-4eb4-8120-f0ade5f4e2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63f6636-e810-4eb4-8120-f0ade5f4e2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1164366655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0103b70-5be0-4967-a81d-03dba9023d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17b0c43f71ef416f8f5c112d34d1f86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:48:24Z,use_quota=True,user_id='ca3d02bd757f422b89f8860bc84f120c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bafde25d-eac1-49c7-8fac-e1dc20df8d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bafde25d-eac1-49c7-8fac-e1dc20df8d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378bac55-a244-4521-ae6a-d27ff54db66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378bac55-a244-4521-ae6a-d27ff54db66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0103b70-5be0-4967-a81d-03dba9023d6a', 'volume_name': 'volume-c0103b70-5be0-4967-a81d-03dba9023d6a', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce63013b-f093-4a44-9dde-aaf5b1369b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce63013b-f093-4a44-9dde-aaf5b1369b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d28ad794-9c56-4689-9eea-d0ae108c2ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:24 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Volume c0103b70-5be0-4967-a81d-03dba9023d6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0103b70-5be0-4967-a81d-03dba9023d6a', 'volume_size': 1} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:48:24 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100 1073741824" returned: 0 in 0.561s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:25 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100 Nov 06 18:48:25 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:25 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100" returned: 0 in 0.420s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:48:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:48:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.888s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:48:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1164366655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0103b70-5be0-4967-a81d-03dba9023d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17b0c43f71ef416f8f5c112d34d1f86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:48:24Z,use_quota=True,user_id='ca3d02bd757f422b89f8860bc84f120c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:48:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Creating volume c0103b70-5be0-4967-a81d-03dba9023d6a {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:48:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:48:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:48:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:48:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:48:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:48:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:48:25 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:48:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0103b70-5be0-4967-a81d-03dba9023d6a 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:25 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0103b70-5be0-4967-a81d-03dba9023d6a 1073741824 Nov 06 18:48:25 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (634b18cf-8923-4d97-bceb-36136e0902ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa7be17-8236-4b37-9cb8-1978d35fbb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:25 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Volume volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100 (58c261d1-2104-4cb4-9c3f-040e5a1d4100): created successfully Nov 06 18:48:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa7be17-8236-4b37-9cb8-1978d35fbb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Flow 'volume_create_manager' (7073b822-7e23-48a5-8f4c-2b5f3fe78829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:48:25 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-1c3d6f81-75e5-4f1b-a0a3-cc9bfade7103 tempest-TestImageHashVerification-1507794378 None] Created volume successfully. Nov 06 18:48:25 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0103b70-5be0-4967-a81d-03dba9023d6a 1073741824" returned: 0 in 0.502s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0103b70-5be0-4967-a81d-03dba9023d6a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:25 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0103b70-5be0-4967-a81d-03dba9023d6a Nov 06 18:48:26 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:26 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0103b70-5be0-4967-a81d-03dba9023d6a" returned: 0 in 0.294s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:26 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:48:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:48:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d28ad794-9c56-4689-9eea-d0ae108c2ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0103b70-5be0-4967-a81d-03dba9023d6a', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ba015c-dcbf-4bc7-80f0-c60398e75f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:26 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Volume volume-c0103b70-5be0-4967-a81d-03dba9023d6a (c0103b70-5be0-4967-a81d-03dba9023d6a): created successfully Nov 06 18:48:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ba015c-dcbf-4bc7-80f0-c60398e75f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Flow 'volume_create_manager' (df67b39d-c92f-4d7a-b23f-7207314f5844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:48:26 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-1d3d0fa4-3359-4b15-acc5-4a66dc0993d4 tempest-ProjectReaderTests-239819983 None] Created volume successfully. Nov 06 18:48:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2115c414-13f6-438e-ade8-ae7be3dcedd2 tempest-TestImageHashVerification-1507794378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:48:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2115c414-13f6-438e-ade8-ae7be3dcedd2 tempest-TestImageHashVerification-1507794378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:48:26 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[44801761-3b38-4d0e-b65f-b9bff6266aee]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:48:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2115c414-13f6-438e-ade8-ae7be3dcedd2 tempest-TestImageHashVerification-1507794378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:26 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100 Nov 06 18:48:26 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:27 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2115c414-13f6-438e-ade8-ae7be3dcedd2 tempest-TestImageHashVerification-1507794378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100" returned: 0 in 0.415s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:27 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38e644e-3e6f-432f-954c-96a7c6390fb6]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:48:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2115c414-13f6-438e-ade8-ae7be3dcedd2 tempest-TestImageHashVerification-1507794378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ab78c570-b7f2-4167-b6f8-b42d95dfa3a6 tempest-ProjectReaderTests-239819983 None] Acquiring lock "cinder-c0103b70-5be0-4967-a81d-03dba9023d6a-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:48:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ab78c570-b7f2-4167-b6f8-b42d95dfa3a6 tempest-ProjectReaderTests-239819983 None] Lock "cinder-c0103b70-5be0-4967-a81d-03dba9023d6a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:48:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ab78c570-b7f2-4167-b6f8-b42d95dfa3a6 tempest-ProjectReaderTests-239819983 None] Acquiring lock "cinder-quobyte-c0103b70-5be0-4967-a81d-03dba9023d6a" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:48:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ab78c570-b7f2-4167-b6f8-b42d95dfa3a6 tempest-ProjectReaderTests-239819983 None] Lock "cinder-quobyte-c0103b70-5be0-4967-a81d-03dba9023d6a" acquired by "delete_volume" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:48:27 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100 Nov 06 18:48:27 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:27 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74821b8-595b-44e0-ae88-1612e122304c]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:48:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab78c570-b7f2-4167-b6f8-b42d95dfa3a6 tempest-ProjectReaderTests-239819983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0103b70-5be0-4967-a81d-03dba9023d6a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:27 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0103b70-5be0-4967-a81d-03dba9023d6a Nov 06 18:48:27 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:27 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2115c414-13f6-438e-ade8-ae7be3dcedd2 tempest-TestImageHashVerification-1507794378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100" returned: 0 in 0.409s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2115c414-13f6-438e-ade8-ae7be3dcedd2 tempest-TestImageHashVerification-1507794378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100 /opt/stack/data/cinder/conversion/58c261d1-2104-4cb4-9c3f-040e5a1d4100.temp_image.cb741a0a-9f89-49ac-919b-3feda96e017930p4soly.img {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:27 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100 /opt/stack/data/cinder/conversion/58c261d1-2104-4cb4-9c3f-040e5a1d4100.temp_image.cb741a0a-9f89-49ac-919b-3feda96e017930p4soly.img Nov 06 18:48:27 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:27 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab78c570-b7f2-4167-b6f8-b42d95dfa3a6 tempest-ProjectReaderTests-239819983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0103b70-5be0-4967-a81d-03dba9023d6a" returned: 0 in 0.404s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab78c570-b7f2-4167-b6f8-b42d95dfa3a6 tempest-ProjectReaderTests-239819983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0103b70-5be0-4967-a81d-03dba9023d6a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:27 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0103b70-5be0-4967-a81d-03dba9023d6a Nov 06 18:48:27 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:28 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab78c570-b7f2-4167-b6f8-b42d95dfa3a6 tempest-ProjectReaderTests-239819983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0103b70-5be0-4967-a81d-03dba9023d6a" returned: 0 in 0.353s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:28 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ab78c570-b7f2-4167-b6f8-b42d95dfa3a6 tempest-ProjectReaderTests-239819983 None] Lock "cinder-quobyte-c0103b70-5be0-4967-a81d-03dba9023d6a" released by "delete_volume" :: held 0.818s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:48:28 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-ab78c570-b7f2-4167-b6f8-b42d95dfa3a6 tempest-ProjectReaderTests-239819983 None] Created reservations ['a93676d7-c22a-4930-bf5d-5db98da23897', '1b9e5753-6320-48c5-908b-7c48377e6840', 'aca54739-a680-4493-aa84-b7d53694f74a', 'f06f304c-03b4-4f49-968b-89ee3708ca1f'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:48:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ab78c570-b7f2-4167-b6f8-b42d95dfa3a6 tempest-ProjectReaderTests-239819983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:48:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ab78c570-b7f2-4167-b6f8-b42d95dfa3a6 tempest-ProjectReaderTests-239819983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:48:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ab78c570-b7f2-4167-b6f8-b42d95dfa3a6 tempest-ProjectReaderTests-239819983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:48:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ab78c570-b7f2-4167-b6f8-b42d95dfa3a6 tempest-ProjectReaderTests-239819983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:48:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ab78c570-b7f2-4167-b6f8-b42d95dfa3a6 tempest-ProjectReaderTests-239819983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:48:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab78c570-b7f2-4167-b6f8-b42d95dfa3a6 tempest-ProjectReaderTests-239819983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:28 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:48:28 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:28 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Flow 'volume_create_manager' (8f52e498-6a58-4d55-a491-fc3d83419307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e01592-3516-4f15-83a2-0e7395faf1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e01592-3516-4f15-83a2-0e7395faf1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1934841346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ffe90b-88ba-4cd2-94c2-cb341ca63e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0dbd15a35f4a169dde3d16f6781a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:48:29Z,use_quota=True,user_id='cd4f51027fbd46c38534817e952255e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808cab07-1f0a-4c84-b989-13732b6d169c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808cab07-1f0a-4c84-b989-13732b6d169c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:29 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08406df1-cf47-40f0-8d99-fda516087aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08406df1-cf47-40f0-8d99-fda516087aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03ffe90b-88ba-4cd2-94c2-cb341ca63e0a', 'volume_name': 'volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc0b05f-bebc-46c1-a126-93b7a6bea1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc0b05f-bebc-46c1-a126-93b7a6bea1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30730d0-970c-4a40-907f-53fa94bae20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:29 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Volume 03ffe90b-88ba-4cd2-94c2-cb341ca63e0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a', 'volume_size': 1} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab78c570-b7f2-4167-b6f8-b42d95dfa3a6 tempest-ProjectReaderTests-239819983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.736s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-ab78c570-b7f2-4167-b6f8-b42d95dfa3a6 tempest-ProjectReaderTests-239819983 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:48:29 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-ab78c570-b7f2-4167-b6f8-b42d95dfa3a6 tempest-ProjectReaderTests-239819983 None] Deleted volume successfully. Nov 06 18:48:29 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:48:29 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ab78c570-b7f2-4167-b6f8-b42d95dfa3a6 tempest-ProjectReaderTests-239819983 None] Lock "cinder-c0103b70-5be0-4967-a81d-03dba9023d6a-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Flow 'volume_create_manager' (4ddd1158-ae41-4410-8a32-bb5611d6707e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f743fa4-0840-4078-b5f2-86e83863fc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:29 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.655s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 29 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f743fa4-0840-4078-b5f2-86e83863fc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1216207884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36bbd214-b33a-400f-9370-4c4944925ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17b0c43f71ef416f8f5c112d34d1f86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:48:30Z,use_quota=True,user_id='ca3d02bd757f422b89f8860bc84f120c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ad718f-74f1-4ee2-9fdb-a619b269c9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ad718f-74f1-4ee2-9fdb-a619b269c9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9123759d-8140-4477-b040-f9afa6ce3f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9123759d-8140-4477-b040-f9afa6ce3f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36bbd214-b33a-400f-9370-4c4944925ecf', 'volume_name': 'volume-36bbd214-b33a-400f-9370-4c4944925ecf', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645b7483-0d33-41e0-bc78-447cd884193c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645b7483-0d33-41e0-bc78-447cd884193c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf0a606-e3f0-49d7-9069-6e9bf9ec2bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:30 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Volume 36bbd214-b33a-400f-9370-4c4944925ecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36bbd214-b33a-400f-9370-4c4944925ecf', 'volume_size': 1} Nov 06 18:48:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:48:35 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2115c414-13f6-438e-ade8-ae7be3dcedd2 tempest-TestImageHashVerification-1507794378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100 /opt/stack/data/cinder/conversion/58c261d1-2104-4cb4-9c3f-040e5a1d4100.temp_image.cb741a0a-9f89-49ac-919b-3feda96e017930p4soly.img" returned: 0 in 7.479s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:35 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[6828294a-e390-4a34-a6a1-a91560c8aa9f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:48:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2115c414-13f6-438e-ade8-ae7be3dcedd2 tempest-TestImageHashVerification-1507794378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:35 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100 Nov 06 18:48:35 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:35 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2115c414-13f6-438e-ade8-ae7be3dcedd2 tempest-TestImageHashVerification-1507794378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100" returned: 0 in 0.544s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:35 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-2115c414-13f6-438e-ade8-ae7be3dcedd2 tempest-TestImageHashVerification-1507794378 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100, size 1024.00 MB, duration 7.48 sec, destination /opt/stack/data/cinder/conversion/58c261d1-2104-4cb4-9c3f-040e5a1d4100.temp_image.cb741a0a-9f89-49ac-919b-3feda96e017930p4soly.img {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:48:35 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-2115c414-13f6-438e-ade8-ae7be3dcedd2 tempest-TestImageHashVerification-1507794378 None] Converted 1024.00 MB image at 136.91 MB/s Nov 06 18:48:35 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-2115c414-13f6-438e-ade8-ae7be3dcedd2 tempest-TestImageHashVerification-1507794378 None] cb741a0a-9f89-49ac-919b-3feda96e0179 was raw, no need to convert to raw {{(pid=86794) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1180}} Nov 06 18:48:45 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=16,cinder:UPDATE=29,cinder:INSERT=5,cinder:DELETE=4 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:48:45 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=24,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:48:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2115c414-13f6-438e-ade8-ae7be3dcedd2 tempest-TestImageHashVerification-1507794378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.836s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:48:56 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2115c414-13f6-438e-ade8-ae7be3dcedd2 tempest-TestImageHashVerification-1507794378 None] Uploaded volume to glance image-id: cb741a0a-9f89-49ac-919b-3feda96e0179. {{(pid=86794) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 18:48:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.470s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:48:56 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1934841346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ffe90b-88ba-4cd2-94c2-cb341ca63e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0dbd15a35f4a169dde3d16f6781a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:48:29Z,use_quota=True,user_id='cd4f51027fbd46c38534817e952255e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:48:56 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Creating volume 03ffe90b-88ba-4cd2-94c2-cb341ca63e0a {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:48:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:48:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:48:56 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:48:56 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:48:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:48:56 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:48:56 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:48:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:56 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a 1073741824 Nov 06 18:48:56 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:56 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-2115c414-13f6-438e-ade8-ae7be3dcedd2 tempest-TestImageHashVerification-1507794378 None] Copy volume to image completed successfully. Nov 06 18:48:57 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a 1073741824" returned: 0 in 0.411s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:57 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a Nov 06 18:48:57 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:57 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a" returned: 0 in 0.280s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.366s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1216207884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36bbd214-b33a-400f-9370-4c4944925ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17b0c43f71ef416f8f5c112d34d1f86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:48:30Z,use_quota=True,user_id='ca3d02bd757f422b89f8860bc84f120c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Creating volume 36bbd214-b33a-400f-9370-4c4944925ecf {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:48:57 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36bbd214-b33a-400f-9370-4c4944925ecf 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30730d0-970c-4a40-907f-53fa94bae20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858d6979-ce5b-4c6d-a7cf-0f043ba0068b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:57 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36bbd214-b33a-400f-9370-4c4944925ecf 1073741824 Nov 06 18:48:57 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:57 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Volume volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a (03ffe90b-88ba-4cd2-94c2-cb341ca63e0a): created successfully Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858d6979-ce5b-4c6d-a7cf-0f043ba0068b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Flow 'volume_create_manager' (8f52e498-6a58-4d55-a491-fc3d83419307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:48:57 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c2ded2c0-66c9-473f-928c-b97c097d3342 tempest-TestStampPattern-2006903719 None] Created volume successfully. Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-82caea4f-d91f-4348-95df-d38405bee3ce tempest-TestImageHashVerification-1507794378 None] Acquiring lock "cinder-58c261d1-2104-4cb4-9c3f-040e5a1d4100-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:48:57 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-82caea4f-d91f-4348-95df-d38405bee3ce tempest-TestImageHashVerification-1507794378 None] Lock "cinder-58c261d1-2104-4cb4-9c3f-040e5a1d4100-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:48:58 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36bbd214-b33a-400f-9370-4c4944925ecf 1073741824" returned: 0 in 0.556s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-82caea4f-d91f-4348-95df-d38405bee3ce tempest-TestImageHashVerification-1507794378 None] Acquiring lock "cinder-quobyte-58c261d1-2104-4cb4-9c3f-040e5a1d4100" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-82caea4f-d91f-4348-95df-d38405bee3ce tempest-TestImageHashVerification-1507794378 None] Lock "cinder-quobyte-58c261d1-2104-4cb4-9c3f-040e5a1d4100" acquired by "delete_volume" :: waited 0.029s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36bbd214-b33a-400f-9370-4c4944925ecf {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[8256124b-0086-49c4-a91a-29057bf58e0c]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-82caea4f-d91f-4348-95df-d38405bee3ce tempest-TestImageHashVerification-1507794378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:58 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36bbd214-b33a-400f-9370-4c4944925ecf Nov 06 18:48:58 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:58 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100 Nov 06 18:48:58 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:58 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36bbd214-b33a-400f-9370-4c4944925ecf" returned: 0 in 0.268s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf0a606-e3f0-49d7-9069-6e9bf9ec2bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36bbd214-b33a-400f-9370-4c4944925ecf', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5262718-0c96-4186-85b0-41c639c4e70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:48:58 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Volume volume-36bbd214-b33a-400f-9370-4c4944925ecf (36bbd214-b33a-400f-9370-4c4944925ecf): created successfully Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5262718-0c96-4186-85b0-41c639c4e70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Flow 'volume_create_manager' (4ddd1158-ae41-4410-8a32-bb5611d6707e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:48:58 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-4d15cadf-ce20-44ef-a2cf-4a4619872796 tempest-ProjectReaderTests-239819983 None] Created volume successfully. Nov 06 18:48:58 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-82caea4f-d91f-4348-95df-d38405bee3ce tempest-TestImageHashVerification-1507794378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100" returned: 0 in 0.384s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-82caea4f-d91f-4348-95df-d38405bee3ce tempest-TestImageHashVerification-1507794378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:58 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100 Nov 06 18:48:58 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:58 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-82caea4f-d91f-4348-95df-d38405bee3ce tempest-TestImageHashVerification-1507794378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-58c261d1-2104-4cb4-9c3f-040e5a1d4100" returned: 0 in 0.253s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-82caea4f-d91f-4348-95df-d38405bee3ce tempest-TestImageHashVerification-1507794378 None] Lock "cinder-quobyte-58c261d1-2104-4cb4-9c3f-040e5a1d4100" released by "delete_volume" :: held 0.698s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-82caea4f-d91f-4348-95df-d38405bee3ce tempest-TestImageHashVerification-1507794378 None] Created reservations ['67100c68-1fd6-4e5c-8067-f2fb119cc143', '25e5453d-b03d-40d4-ae36-4d35307d9d85', 'd4c2f0b7-bf79-451b-969c-f11f9af5f55e', 'be639272-600f-4c0d-8d0a-ea61b6cc1bfa'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-82caea4f-d91f-4348-95df-d38405bee3ce tempest-TestImageHashVerification-1507794378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-82caea4f-d91f-4348-95df-d38405bee3ce tempest-TestImageHashVerification-1507794378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-82caea4f-d91f-4348-95df-d38405bee3ce tempest-TestImageHashVerification-1507794378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-82caea4f-d91f-4348-95df-d38405bee3ce tempest-TestImageHashVerification-1507794378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-82caea4f-d91f-4348-95df-d38405bee3ce tempest-TestImageHashVerification-1507794378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:48:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-82caea4f-d91f-4348-95df-d38405bee3ce tempest-TestImageHashVerification-1507794378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:58 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:48:58 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:59 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-82caea4f-d91f-4348-95df-d38405bee3ce tempest-TestImageHashVerification-1507794378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.259s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:59 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-82caea4f-d91f-4348-95df-d38405bee3ce tempest-TestImageHashVerification-1507794378 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:48:59 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-82caea4f-d91f-4348-95df-d38405bee3ce tempest-TestImageHashVerification-1507794378 None] Deleted volume successfully. Nov 06 18:48:59 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-82caea4f-d91f-4348-95df-d38405bee3ce tempest-TestImageHashVerification-1507794378 None] Lock "cinder-58c261d1-2104-4cb4-9c3f-040e5a1d4100-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:48:59 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b7f85d21-748b-45df-9db9-91c21e92a0b7 tempest-ProjectReaderTests-239819983 None] Acquiring lock "cinder-36bbd214-b33a-400f-9370-4c4944925ecf-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:48:59 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b7f85d21-748b-45df-9db9-91c21e92a0b7 tempest-ProjectReaderTests-239819983 None] Lock "cinder-36bbd214-b33a-400f-9370-4c4944925ecf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:48:59 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b7f85d21-748b-45df-9db9-91c21e92a0b7 tempest-ProjectReaderTests-239819983 None] Acquiring lock "cinder-quobyte-36bbd214-b33a-400f-9370-4c4944925ecf" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:48:59 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b7f85d21-748b-45df-9db9-91c21e92a0b7 tempest-ProjectReaderTests-239819983 None] Lock "cinder-quobyte-36bbd214-b33a-400f-9370-4c4944925ecf" acquired by "delete_volume" :: waited 0.014s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:48:59 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[f243fc26-4de2-4624-8f6b-be127776e98f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:48:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b7f85d21-748b-45df-9db9-91c21e92a0b7 tempest-ProjectReaderTests-239819983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36bbd214-b33a-400f-9370-4c4944925ecf {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:59 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36bbd214-b33a-400f-9370-4c4944925ecf Nov 06 18:48:59 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:48:59 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Nov 06 18:48:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b7f85d21-748b-45df-9db9-91c21e92a0b7 tempest-ProjectReaderTests-239819983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36bbd214-b33a-400f-9370-4c4944925ecf" returned: 0 in 0.388s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:48:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b7f85d21-748b-45df-9db9-91c21e92a0b7 tempest-ProjectReaderTests-239819983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36bbd214-b33a-400f-9370-4c4944925ecf {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:48:59 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36bbd214-b33a-400f-9370-4c4944925ecf Nov 06 18:48:59 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:00 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b7f85d21-748b-45df-9db9-91c21e92a0b7 tempest-ProjectReaderTests-239819983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-36bbd214-b33a-400f-9370-4c4944925ecf" returned: 0 in 0.253s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:00 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b7f85d21-748b-45df-9db9-91c21e92a0b7 tempest-ProjectReaderTests-239819983 None] Lock "cinder-quobyte-36bbd214-b33a-400f-9370-4c4944925ecf" released by "delete_volume" :: held 0.697s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:00 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-b7f85d21-748b-45df-9db9-91c21e92a0b7 tempest-ProjectReaderTests-239819983 None] Created reservations ['d0e15edd-c809-468d-821c-a50378e8c0d6', 'a9da23cc-ff48-46cd-9b44-c8a296d5dad3', 'b87158c1-1160-4cc9-8ed2-9c3710f02f31', '3c3ecfde-e891-42af-8519-5e01f77f67bd'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:49:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b7f85d21-748b-45df-9db9-91c21e92a0b7 tempest-ProjectReaderTests-239819983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b7f85d21-748b-45df-9db9-91c21e92a0b7 tempest-ProjectReaderTests-239819983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b7f85d21-748b-45df-9db9-91c21e92a0b7 tempest-ProjectReaderTests-239819983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-b7f85d21-748b-45df-9db9-91c21e92a0b7 tempest-ProjectReaderTests-239819983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-b7f85d21-748b-45df-9db9-91c21e92a0b7 tempest-ProjectReaderTests-239819983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b7f85d21-748b-45df-9db9-91c21e92a0b7 tempest-ProjectReaderTests-239819983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:00 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:49:00 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:00 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b7f85d21-748b-45df-9db9-91c21e92a0b7 tempest-ProjectReaderTests-239819983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.276s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:00 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-b7f85d21-748b-45df-9db9-91c21e92a0b7 tempest-ProjectReaderTests-239819983 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:49:00 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-b7f85d21-748b-45df-9db9-91c21e92a0b7 tempest-ProjectReaderTests-239819983 None] Deleted volume successfully. Nov 06 18:49:00 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b7f85d21-748b-45df-9db9-91c21e92a0b7 tempest-ProjectReaderTests-239819983 None] Lock "cinder-36bbd214-b33a-400f-9370-4c4944925ecf-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:00 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:49:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Flow 'volume_create_manager' (1a54645d-5603-435a-b6ee-132848edb5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9904f3c-bacd-4bf1-b21e-2cca203050c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9904f3c-bacd-4bf1-b21e-2cca203050c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2112548694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa03a1e2-8615-4f33-8d9c-b3ca56961dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17b0c43f71ef416f8f5c112d34d1f86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:01Z,use_quota=True,user_id='ca3d02bd757f422b89f8860bc84f120c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd5d809-2f90-44ac-99a1-f077ee934f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd5d809-2f90-44ac-99a1-f077ee934f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88fc6a00-68e9-4c7a-a8f9-62b1899b9795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88fc6a00-68e9-4c7a-a8f9-62b1899b9795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa03a1e2-8615-4f33-8d9c-b3ca56961dc3', 'volume_name': 'volume-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ef0465-7014-407a-8c96-1fc76b14538d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ef0465-7014-407a-8c96-1fc76b14538d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c02b815d-9140-4b89-a891-c7fba32fb593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:01 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Volume aa03a1e2-8615-4f33-8d9c-b3ca56961dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3', 'volume_size': 1} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2112548694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa03a1e2-8615-4f33-8d9c-b3ca56961dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17b0c43f71ef416f8f5c112d34d1f86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:01Z,use_quota=True,user_id='ca3d02bd757f422b89f8860bc84f120c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Creating volume aa03a1e2-8615-4f33-8d9c-b3ca56961dc3 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:49:01 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:01 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3 1073741824 Nov 06 18:49:01 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:01 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3 1073741824" returned: 0 in 0.472s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:01 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3 Nov 06 18:49:01 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:01 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3" returned: 0 in 0.259s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c02b815d-9140-4b89-a891-c7fba32fb593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232a95ea-3973-4def-9174-0674868fbdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:01 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Volume volume-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3 (aa03a1e2-8615-4f33-8d9c-b3ca56961dc3): created successfully Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232a95ea-3973-4def-9174-0674868fbdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:01 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Flow 'volume_create_manager' (1a54645d-5603-435a-b6ee-132848edb5e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:01 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-72192dbd-993b-4679-a55f-808dcca555ad tempest-ProjectReaderTests-239819983 None] Created volume successfully. Nov 06 18:49:02 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9659eef0-7d97-4a00-9be6-12a1bd67cbef tempest-ProjectReaderTests-239819983 None] Acquiring lock "cinder-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:02 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9659eef0-7d97-4a00-9be6-12a1bd67cbef tempest-ProjectReaderTests-239819983 None] Lock "cinder-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:02 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9659eef0-7d97-4a00-9be6-12a1bd67cbef tempest-ProjectReaderTests-239819983 None] Acquiring lock "cinder-quobyte-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:02 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9659eef0-7d97-4a00-9be6-12a1bd67cbef tempest-ProjectReaderTests-239819983 None] Lock "cinder-quobyte-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3" acquired by "delete_volume" :: waited 0.018s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:02 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[19aef553-a6e4-4c53-bdc2-f52b852b2721]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:49:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9659eef0-7d97-4a00-9be6-12a1bd67cbef tempest-ProjectReaderTests-239819983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:02 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3 Nov 06 18:49:02 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:02 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9659eef0-7d97-4a00-9be6-12a1bd67cbef tempest-ProjectReaderTests-239819983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3" returned: 0 in 0.424s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9659eef0-7d97-4a00-9be6-12a1bd67cbef tempest-ProjectReaderTests-239819983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:02 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3 Nov 06 18:49:02 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:02 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9659eef0-7d97-4a00-9be6-12a1bd67cbef tempest-ProjectReaderTests-239819983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3" returned: 0 in 0.345s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:02 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9659eef0-7d97-4a00-9be6-12a1bd67cbef tempest-ProjectReaderTests-239819983 None] Lock "cinder-quobyte-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3" released by "delete_volume" :: held 0.823s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-428d4569-a61b-40b1-8c72-ea1f51112e91 req-bfbb00db-6d69-4091-a1fb-681546e397c8 tempest-TestStampPattern-2006903719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-428d4569-a61b-40b1-8c72-ea1f51112e91 req-bfbb00db-6d69-4091-a1fb-681546e397c8 tempest-TestStampPattern-2006903719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-428d4569-a61b-40b1-8c72-ea1f51112e91 req-bfbb00db-6d69-4091-a1fb-681546e397c8 tempest-TestStampPattern-2006903719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:02 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-9659eef0-7d97-4a00-9be6-12a1bd67cbef tempest-ProjectReaderTests-239819983 None] Created reservations ['f5db208a-4e13-47d0-bac9-06fe77fca518', 'f8fada3d-13c3-4402-b5e7-88eeaf88fb68', 'b8376ba3-e730-4c77-8103-32a1a9508845', 'dec4e592-f19e-42c3-a5fd-e3adf434427f'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:49:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-428d4569-a61b-40b1-8c72-ea1f51112e91 req-bfbb00db-6d69-4091-a1fb-681546e397c8 tempest-TestStampPattern-2006903719 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07f9ff01-9afe-4e82-aa12-f99fcf1919b9', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:49:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9659eef0-7d97-4a00-9be6-12a1bd67cbef tempest-ProjectReaderTests-239819983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9659eef0-7d97-4a00-9be6-12a1bd67cbef tempest-ProjectReaderTests-239819983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9659eef0-7d97-4a00-9be6-12a1bd67cbef tempest-ProjectReaderTests-239819983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9659eef0-7d97-4a00-9be6-12a1bd67cbef tempest-ProjectReaderTests-239819983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9659eef0-7d97-4a00-9be6-12a1bd67cbef tempest-ProjectReaderTests-239819983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9659eef0-7d97-4a00-9be6-12a1bd67cbef tempest-ProjectReaderTests-239819983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:03 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-428d4569-a61b-40b1-8c72-ea1f51112e91 req-bfbb00db-6d69-4091-a1fb-681546e397c8 tempest-TestStampPattern-2006903719 None] attachment_update completed successfully. Nov 06 18:49:03 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:49:03 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:03 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9659eef0-7d97-4a00-9be6-12a1bd67cbef tempest-ProjectReaderTests-239819983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.449s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:03 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-9659eef0-7d97-4a00-9be6-12a1bd67cbef tempest-ProjectReaderTests-239819983 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:49:03 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-9659eef0-7d97-4a00-9be6-12a1bd67cbef tempest-ProjectReaderTests-239819983 None] Deleted volume successfully. Nov 06 18:49:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9659eef0-7d97-4a00-9be6-12a1bd67cbef tempest-ProjectReaderTests-239819983 None] Lock "cinder-aa03a1e2-8615-4f33-8d9c-b3ca56961dc3-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:08 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-d078d938-c114-46d2-83ed-415dc6a9c4ba req-49c50b28-e1e4-40ac-bb72-27bc27556937 tempest-TestStampPattern-2006903719 None] Terminate volume connection completed successfully. Nov 06 18:49:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-d078d938-c114-46d2-83ed-415dc6a9c4ba req-49c50b28-e1e4-40ac-bb72-27bc27556937 tempest-TestStampPattern-2006903719 None] Deleting attachment 07f9ff01-9afe-4e82-aa12-f99fcf1919b9. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:49:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-43bff643-209f-43f6-ba9c-4818092ef3d4 tempest-TestStampPattern-2006903719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-43bff643-209f-43f6-ba9c-4818092ef3d4 tempest-TestStampPattern-2006903719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-43bff643-209f-43f6-ba9c-4818092ef3d4 tempest-TestStampPattern-2006903719 None] Creating offline snapshot ffc46989-24fb-4c40-99fe-370f8dc54f47 of volume 03ffe90b-88ba-4cd2-94c2-cb341ca63e0a {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:49:09 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88a2bb4-6f5f-4364-a5be-305b471fed72]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:49:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-43bff643-209f-43f6-ba9c-4818092ef3d4 tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:09 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a Nov 06 18:49:09 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:09 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-43bff643-209f-43f6-ba9c-4818092ef3d4 tempest-TestStampPattern-2006903719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a" returned: 0 in 0.356s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-43bff643-209f-43f6-ba9c-4818092ef3d4 tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:09 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47 1G Nov 06 18:49:09 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:10 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-43bff643-209f-43f6-ba9c-4818092ef3d4 tempest-TestStampPattern-2006903719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47 1G" returned: 0 in 0.423s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-43bff643-209f-43f6-ba9c-4818092ef3d4 tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:10 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47 Nov 06 18:49:10 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:10 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-43bff643-209f-43f6-ba9c-4818092ef3d4 tempest-TestStampPattern-2006903719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47" returned: 0 in 0.304s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:10 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-43bff643-209f-43f6-ba9c-4818092ef3d4 tempest-TestStampPattern-2006903719 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47 is being set with open permissions: ugo+rw Nov 06 18:49:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-43bff643-209f-43f6-ba9c-4818092ef3d4 tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:10 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47 Nov 06 18:49:10 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:10 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-43bff643-209f-43f6-ba9c-4818092ef3d4 tempest-TestStampPattern-2006903719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47" returned: 0 in 0.234s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-43bff643-209f-43f6-ba9c-4818092ef3d4 tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:10 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.info Nov 06 18:49:10 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:11 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-43bff643-209f-43f6-ba9c-4818092ef3d4 tempest-TestStampPattern-2006903719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.info" returned: 0 in 0.271s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:11 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-43bff643-209f-43f6-ba9c-4818092ef3d4 tempest-TestStampPattern-2006903719 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.info is being set with open permissions: ugo+rw Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-43bff643-209f-43f6-ba9c-4818092ef3d4 tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:11 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.info Nov 06 18:49:11 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:11 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-43bff643-209f-43f6-ba9c-4818092ef3d4 tempest-TestStampPattern-2006903719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.info" returned: 0 in 0.267s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-43bff643-209f-43f6-ba9c-4818092ef3d4 tempest-TestStampPattern-2006903719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.990s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:11 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-43bff643-209f-43f6-ba9c-4818092ef3d4 tempest-TestStampPattern-2006903719 None] Create snapshot completed successfully Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Flow 'volume_create_manager' (a6792b84-97e5-43f1-87b4-d197b455b4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c0634f-0e1e-4b3c-8913-eb0a4563cc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c0634f-0e1e-4b3c-8913-eb0a4563cc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1702605446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c470c666-945d-4d47-8d16-d21fa205e232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf8948c55a84075b516b9a55d6d8155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:11Z,use_quota=True,user_id='ec778944fa4646ed83f6e5eb4a93c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4dbd8b7-869a-40e4-94e6-8cd9fac46fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4dbd8b7-869a-40e4-94e6-8cd9fac46fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e15931-b7a7-46b5-9680-cc1b0871c5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e15931-b7a7-46b5-9680-cc1b0871c5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c470c666-945d-4d47-8d16-d21fa205e232', 'volume_name': 'volume-c470c666-945d-4d47-8d16-d21fa205e232', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f859f0-2f6c-44f4-b6f7-4af5e0c44b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f859f0-2f6c-44f4-b6f7-4af5e0c44b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20e4b27-3000-45bd-a0ba-f1725efd5dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:11 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Volume c470c666-945d-4d47-8d16-d21fa205e232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c470c666-945d-4d47-8d16-d21fa205e232', 'volume_size': 1} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1702605446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c470c666-945d-4d47-8d16-d21fa205e232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf8948c55a84075b516b9a55d6d8155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:11Z,use_quota=True,user_id='ec778944fa4646ed83f6e5eb4a93c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Creating volume c470c666-945d-4d47-8d16-d21fa205e232 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:49:11 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c470c666-945d-4d47-8d16-d21fa205e232 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:11 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c470c666-945d-4d47-8d16-d21fa205e232 1073741824 Nov 06 18:49:11 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Flow 'volume_create_manager' (e0536748-3b88-4170-96be-867af383d6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21025f6-7fd5-4db2-9e64-e90b784ed76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21025f6-7fd5-4db2-9e64-e90b784ed76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-769050907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3643a9b6-a81b-4eeb-b4c7-ff403f764926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf8948c55a84075b516b9a55d6d8155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:12Z,use_quota=True,user_id='ec778944fa4646ed83f6e5eb4a93c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07593f1-0474-45a7-8d5f-7fa0c9d6b054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07593f1-0474-45a7-8d5f-7fa0c9d6b054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584c8779-88c5-4b55-8d04-1f0e60f99653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584c8779-88c5-4b55-8d04-1f0e60f99653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3643a9b6-a81b-4eeb-b4c7-ff403f764926', 'volume_name': 'volume-3643a9b6-a81b-4eeb-b4c7-ff403f764926', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3bb87a7-c248-4aa7-978d-1cfbb3b2b414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3bb87a7-c248-4aa7-978d-1cfbb3b2b414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e8968f5-23ab-447b-b5ca-27788813f7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:11 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Volume 3643a9b6-a81b-4eeb-b4c7-ff403f764926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3643a9b6-a81b-4eeb-b4c7-ff403f764926', 'volume_size': 1} Nov 06 18:49:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:12 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c470c666-945d-4d47-8d16-d21fa205e232 1073741824" returned: 0 in 0.514s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c470c666-945d-4d47-8d16-d21fa205e232 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:12 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c470c666-945d-4d47-8d16-d21fa205e232 Nov 06 18:49:12 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Flow 'volume_create_manager' (2be4266c-22b5-4605-bead-dbb8803a0c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92302d3-9aef-4dc4-8bfb-5cce18100472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92302d3-9aef-4dc4-8bfb-5cce18100472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1589153877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe21be9-d083-4915-b9aa-b62a18d5be31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf8948c55a84075b516b9a55d6d8155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:12Z,use_quota=True,user_id='ec778944fa4646ed83f6e5eb4a93c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e55aae69-3231-4f82-9d56-e6844e64507a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e55aae69-3231-4f82-9d56-e6844e64507a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927b9551-0ce5-4023-a78a-896347ba9c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927b9551-0ce5-4023-a78a-896347ba9c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fe21be9-d083-4915-b9aa-b62a18d5be31', 'volume_name': 'volume-2fe21be9-d083-4915-b9aa-b62a18d5be31', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e2bb94c-cd41-42a6-858f-2bb656eb7a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e2bb94c-cd41-42a6-858f-2bb656eb7a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226214a4-e17d-4477-9dd7-e04ce45a0d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:12 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Volume 2fe21be9-d083-4915-b9aa-b62a18d5be31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fe21be9-d083-4915-b9aa-b62a18d5be31', 'volume_size': 1} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:12 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c470c666-945d-4d47-8d16-d21fa205e232" returned: 0 in 0.285s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.494s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-769050907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3643a9b6-a81b-4eeb-b4c7-ff403f764926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf8948c55a84075b516b9a55d6d8155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:12Z,use_quota=True,user_id='ec778944fa4646ed83f6e5eb4a93c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Creating volume 3643a9b6-a81b-4eeb-b4c7-ff403f764926 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:49:12 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3643a9b6-a81b-4eeb-b4c7-ff403f764926 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20e4b27-3000-45bd-a0ba-f1725efd5dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c470c666-945d-4d47-8d16-d21fa205e232', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd8661e-a327-4510-93af-efcecce7d3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:12 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3643a9b6-a81b-4eeb-b4c7-ff403f764926 1073741824 Nov 06 18:49:12 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:12 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Volume volume-c470c666-945d-4d47-8d16-d21fa205e232 (c470c666-945d-4d47-8d16-d21fa205e232): created successfully Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd8661e-a327-4510-93af-efcecce7d3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Flow 'volume_create_manager' (a6792b84-97e5-43f1-87b4-d197b455b4f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:12 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-0ec9f987-a2db-4e77-b025-61b1e3c240f5 tempest-CreateVolumesFromImageTest-1062767329 None] Created volume successfully. Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Flow 'volume_create_manager' (e78a0570-faa1-4718-a87a-f6fcbaf048b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d56c12-e9f4-4d56-8034-31b82f5b445f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d56c12-e9f4-4d56-8034-31b82f5b445f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-198707805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5cd5752-8f47-4ffc-863e-079fa2fbe196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf8948c55a84075b516b9a55d6d8155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:13Z,use_quota=True,user_id='ec778944fa4646ed83f6e5eb4a93c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5cd5dd-867d-4157-8e1a-d253ba46ded5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5cd5dd-867d-4157-8e1a-d253ba46ded5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ac1266-1427-4e8d-af90-9301e310e28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ac1266-1427-4e8d-af90-9301e310e28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5cd5752-8f47-4ffc-863e-079fa2fbe196', 'volume_name': 'volume-e5cd5752-8f47-4ffc-863e-079fa2fbe196', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3462feeb-a747-43e1-88b2-7706dd05bbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3462feeb-a747-43e1-88b2-7706dd05bbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c87731f-5b70-4efb-91ae-0b0da2071c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:12 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Volume e5cd5752-8f47-4ffc-863e-079fa2fbe196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5cd5752-8f47-4ffc-863e-079fa2fbe196', 'volume_size': 1} Nov 06 18:49:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Flow 'volume_create_manager' (c7d1106a-9479-4908-bfc3-b94173127efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7161f17-4046-46c8-abea-b8f433e9dc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:13 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7161f17-4046-46c8-abea-b8f433e9dc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-581095385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3bbdd30-1836-4e0e-b83b-2dd470ed085c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf8948c55a84075b516b9a55d6d8155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:13Z,use_quota=True,user_id='ec778944fa4646ed83f6e5eb4a93c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1e1ac8-ee60-44d9-a1b1-c29670460113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1e1ac8-ee60-44d9-a1b1-c29670460113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a34e819-a0b7-4511-af9f-b04d83914b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a34e819-a0b7-4511-af9f-b04d83914b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3bbdd30-1836-4e0e-b83b-2dd470ed085c', 'volume_name': 'volume-a3bbdd30-1836-4e0e-b83b-2dd470ed085c', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc1dec2-fb7a-40b3-a3d4-b9925398ee4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc1dec2-fb7a-40b3-a3d4-b9925398ee4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93cd0de-372f-4fb6-a6c3-b55021cd3c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:13 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Volume a3bbdd30-1836-4e0e-b83b-2dd470ed085c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3bbdd30-1836-4e0e-b83b-2dd470ed085c', 'volume_size': 1} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3643a9b6-a81b-4eeb-b4c7-ff403f764926 1073741824" returned: 0 in 0.655s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3643a9b6-a81b-4eeb-b4c7-ff403f764926 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:13 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3643a9b6-a81b-4eeb-b4c7-ff403f764926 Nov 06 18:49:13 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:13 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3643a9b6-a81b-4eeb-b4c7-ff403f764926" returned: 0 in 0.262s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.076s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1589153877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe21be9-d083-4915-b9aa-b62a18d5be31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf8948c55a84075b516b9a55d6d8155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:12Z,use_quota=True,user_id='ec778944fa4646ed83f6e5eb4a93c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Creating volume 2fe21be9-d083-4915-b9aa-b62a18d5be31 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:49:13 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2fe21be9-d083-4915-b9aa-b62a18d5be31 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e8968f5-23ab-447b-b5ca-27788813f7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3643a9b6-a81b-4eeb-b4c7-ff403f764926', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:13 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2fe21be9-d083-4915-b9aa-b62a18d5be31 1073741824 Nov 06 18:49:13 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da85e17-893c-4dbe-8f4c-21f705e919db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:13 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Volume volume-3643a9b6-a81b-4eeb-b4c7-ff403f764926 (3643a9b6-a81b-4eeb-b4c7-ff403f764926): created successfully Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da85e17-893c-4dbe-8f4c-21f705e919db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Flow 'volume_create_manager' (e0536748-3b88-4170-96be-867af383d6e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:13 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-692ba9c3-afaf-4dc7-9817-fde3695f04f4 tempest-CreateVolumesFromImageTest-1062767329 None] Created volume successfully. Nov 06 18:49:13 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2fe21be9-d083-4915-b9aa-b62a18d5be31 1073741824" returned: 0 in 0.486s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2fe21be9-d083-4915-b9aa-b62a18d5be31 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:13 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2fe21be9-d083-4915-b9aa-b62a18d5be31 Nov 06 18:49:13 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:14 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2fe21be9-d083-4915-b9aa-b62a18d5be31" returned: 0 in 0.261s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:49:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.483s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-198707805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5cd5752-8f47-4ffc-863e-079fa2fbe196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf8948c55a84075b516b9a55d6d8155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:13Z,use_quota=True,user_id='ec778944fa4646ed83f6e5eb4a93c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:49:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Creating volume e5cd5752-8f47-4ffc-863e-079fa2fbe196 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:49:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:49:14 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:49:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e5cd5752-8f47-4ffc-863e-079fa2fbe196 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226214a4-e17d-4477-9dd7-e04ce45a0d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fe21be9-d083-4915-b9aa-b62a18d5be31', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:14 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e5cd5752-8f47-4ffc-863e-079fa2fbe196 1073741824 Nov 06 18:49:14 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b80da93-96ee-44a2-867c-5f11ead13631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:14 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Volume volume-2fe21be9-d083-4915-b9aa-b62a18d5be31 (2fe21be9-d083-4915-b9aa-b62a18d5be31): created successfully Nov 06 18:49:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b80da93-96ee-44a2-867c-5f11ead13631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Flow 'volume_create_manager' (2be4266c-22b5-4605-bead-dbb8803a0c15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:14 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-6e810564-0a25-4707-91df-a9679af7d24f tempest-CreateVolumesFromImageTest-1062767329 None] Created volume successfully. Nov 06 18:49:14 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e5cd5752-8f47-4ffc-863e-079fa2fbe196 1073741824" returned: 0 in 0.471s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e5cd5752-8f47-4ffc-863e-079fa2fbe196 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:14 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e5cd5752-8f47-4ffc-863e-079fa2fbe196 Nov 06 18:49:14 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:15 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e5cd5752-8f47-4ffc-863e-079fa2fbe196" returned: 0 in 0.245s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.893s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-581095385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3bbdd30-1836-4e0e-b83b-2dd470ed085c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf8948c55a84075b516b9a55d6d8155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:13Z,use_quota=True,user_id='ec778944fa4646ed83f6e5eb4a93c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Creating volume a3bbdd30-1836-4e0e-b83b-2dd470ed085c {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:49:15 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a3bbdd30-1836-4e0e-b83b-2dd470ed085c 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c87731f-5b70-4efb-91ae-0b0da2071c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5cd5752-8f47-4ffc-863e-079fa2fbe196', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:15 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a3bbdd30-1836-4e0e-b83b-2dd470ed085c 1073741824 Nov 06 18:49:15 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5082e5d9-0ed6-4c49-ab93-defeae05d73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:15 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Volume volume-e5cd5752-8f47-4ffc-863e-079fa2fbe196 (e5cd5752-8f47-4ffc-863e-079fa2fbe196): created successfully Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5082e5d9-0ed6-4c49-ab93-defeae05d73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Flow 'volume_create_manager' (e78a0570-faa1-4718-a87a-f6fcbaf048b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:15 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c6fa6e0e-6e71-4917-85ef-35ef87f5e799 tempest-CreateVolumesFromImageTest-1062767329 None] Created volume successfully. Nov 06 18:49:15 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a3bbdd30-1836-4e0e-b83b-2dd470ed085c 1073741824" returned: 0 in 0.510s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a3bbdd30-1836-4e0e-b83b-2dd470ed085c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:15 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a3bbdd30-1836-4e0e-b83b-2dd470ed085c Nov 06 18:49:15 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:15 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a3bbdd30-1836-4e0e-b83b-2dd470ed085c" returned: 0 in 0.250s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93cd0de-372f-4fb6-a6c3-b55021cd3c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3bbdd30-1836-4e0e-b83b-2dd470ed085c', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa3a6d3-f137-477c-978d-ea1172ab4f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:15 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Volume volume-a3bbdd30-1836-4e0e-b83b-2dd470ed085c (a3bbdd30-1836-4e0e-b83b-2dd470ed085c): created successfully Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa3a6d3-f137-477c-978d-ea1172ab4f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Flow 'volume_create_manager' (c7d1106a-9479-4908-bfc3-b94173127efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:15 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c9104b5a-2af7-40ca-856b-81b026e61350 tempest-CreateVolumesFromImageTest-1062767329 None] Created volume successfully. Nov 06 18:49:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3860551e-26b2-4896-b081-71de95c275a0 tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "cinder-a3bbdd30-1836-4e0e-b83b-2dd470ed085c-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3860551e-26b2-4896-b081-71de95c275a0 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "cinder-a3bbdd30-1836-4e0e-b83b-2dd470ed085c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3860551e-26b2-4896-b081-71de95c275a0 tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "cinder-quobyte-a3bbdd30-1836-4e0e-b83b-2dd470ed085c" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3860551e-26b2-4896-b081-71de95c275a0 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "cinder-quobyte-a3bbdd30-1836-4e0e-b83b-2dd470ed085c" acquired by "delete_volume" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:16 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7e22a1-0a83-4a9e-9cec-18693cc23952]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:49:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3860551e-26b2-4896-b081-71de95c275a0 tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a3bbdd30-1836-4e0e-b83b-2dd470ed085c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:16 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a3bbdd30-1836-4e0e-b83b-2dd470ed085c Nov 06 18:49:16 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:16 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3860551e-26b2-4896-b081-71de95c275a0 tempest-CreateVolumesFromImageTest-1062767329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a3bbdd30-1836-4e0e-b83b-2dd470ed085c" returned: 0 in 0.383s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3860551e-26b2-4896-b081-71de95c275a0 tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a3bbdd30-1836-4e0e-b83b-2dd470ed085c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:16 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a3bbdd30-1836-4e0e-b83b-2dd470ed085c Nov 06 18:49:16 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:17 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3860551e-26b2-4896-b081-71de95c275a0 tempest-CreateVolumesFromImageTest-1062767329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a3bbdd30-1836-4e0e-b83b-2dd470ed085c" returned: 0 in 0.252s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3860551e-26b2-4896-b081-71de95c275a0 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "cinder-quobyte-a3bbdd30-1836-4e0e-b83b-2dd470ed085c" released by "delete_volume" :: held 0.681s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:17 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-3860551e-26b2-4896-b081-71de95c275a0 tempest-CreateVolumesFromImageTest-1062767329 None] Created reservations ['3a87099e-54af-47e9-98ff-7055c047c33d', '4ed02962-febf-438a-8f0f-8692841b70a7', '8b593392-f588-4520-83a4-ae1b738ba587', '05cc9729-4c84-4b01-a91d-aa781875ff4e'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:49:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3860551e-26b2-4896-b081-71de95c275a0 tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3860551e-26b2-4896-b081-71de95c275a0 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3860551e-26b2-4896-b081-71de95c275a0 tempest-CreateVolumesFromImageTest-1062767329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-3860551e-26b2-4896-b081-71de95c275a0 tempest-CreateVolumesFromImageTest-1062767329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-3860551e-26b2-4896-b081-71de95c275a0 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3860551e-26b2-4896-b081-71de95c275a0 tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:17 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:49:17 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:17 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3860551e-26b2-4896-b081-71de95c275a0 tempest-CreateVolumesFromImageTest-1062767329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.283s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:17 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-3860551e-26b2-4896-b081-71de95c275a0 tempest-CreateVolumesFromImageTest-1062767329 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:49:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-06e75b77-446c-4a3a-bd23-ae4d5a7979e1 tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "cinder-e5cd5752-8f47-4ffc-863e-079fa2fbe196-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:17 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-3860551e-26b2-4896-b081-71de95c275a0 tempest-CreateVolumesFromImageTest-1062767329 None] Deleted volume successfully. Nov 06 18:49:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-06e75b77-446c-4a3a-bd23-ae4d5a7979e1 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "cinder-e5cd5752-8f47-4ffc-863e-079fa2fbe196-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3860551e-26b2-4896-b081-71de95c275a0 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "cinder-a3bbdd30-1836-4e0e-b83b-2dd470ed085c-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-06e75b77-446c-4a3a-bd23-ae4d5a7979e1 tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "cinder-quobyte-e5cd5752-8f47-4ffc-863e-079fa2fbe196" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-06e75b77-446c-4a3a-bd23-ae4d5a7979e1 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "cinder-quobyte-e5cd5752-8f47-4ffc-863e-079fa2fbe196" acquired by "delete_volume" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:17 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c64739-edc8-4018-b3f3-88ed9cee491e]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:49:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-06e75b77-446c-4a3a-bd23-ae4d5a7979e1 tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e5cd5752-8f47-4ffc-863e-079fa2fbe196 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:17 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e5cd5752-8f47-4ffc-863e-079fa2fbe196 Nov 06 18:49:17 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:18 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-06e75b77-446c-4a3a-bd23-ae4d5a7979e1 tempest-CreateVolumesFromImageTest-1062767329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e5cd5752-8f47-4ffc-863e-079fa2fbe196" returned: 0 in 0.392s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-06e75b77-446c-4a3a-bd23-ae4d5a7979e1 tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e5cd5752-8f47-4ffc-863e-079fa2fbe196 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:18 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e5cd5752-8f47-4ffc-863e-079fa2fbe196 Nov 06 18:49:18 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:18 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-06e75b77-446c-4a3a-bd23-ae4d5a7979e1 tempest-CreateVolumesFromImageTest-1062767329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-e5cd5752-8f47-4ffc-863e-079fa2fbe196" returned: 0 in 0.265s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-06e75b77-446c-4a3a-bd23-ae4d5a7979e1 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "cinder-quobyte-e5cd5752-8f47-4ffc-863e-079fa2fbe196" released by "delete_volume" :: held 0.709s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:18 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-06e75b77-446c-4a3a-bd23-ae4d5a7979e1 tempest-CreateVolumesFromImageTest-1062767329 None] Created reservations ['3929f6c4-4b51-4ea2-900e-e5a64e127570', 'e3af1c39-609c-4f85-9fc3-8237ec6b768c', '227a10f6-9293-4375-affb-ce2c9eb1161c', '94180ced-56b0-4cf2-b74c-4fe597101763'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:49:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-06e75b77-446c-4a3a-bd23-ae4d5a7979e1 tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-06e75b77-446c-4a3a-bd23-ae4d5a7979e1 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-06e75b77-446c-4a3a-bd23-ae4d5a7979e1 tempest-CreateVolumesFromImageTest-1062767329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-06e75b77-446c-4a3a-bd23-ae4d5a7979e1 tempest-CreateVolumesFromImageTest-1062767329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-06e75b77-446c-4a3a-bd23-ae4d5a7979e1 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-06e75b77-446c-4a3a-bd23-ae4d5a7979e1 tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:18 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:49:18 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:18 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-06e75b77-446c-4a3a-bd23-ae4d5a7979e1 tempest-CreateVolumesFromImageTest-1062767329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.245s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:18 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-06e75b77-446c-4a3a-bd23-ae4d5a7979e1 tempest-CreateVolumesFromImageTest-1062767329 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:49:18 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-06e75b77-446c-4a3a-bd23-ae4d5a7979e1 tempest-CreateVolumesFromImageTest-1062767329 None] Deleted volume successfully. Nov 06 18:49:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-06e75b77-446c-4a3a-bd23-ae4d5a7979e1 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "cinder-e5cd5752-8f47-4ffc-863e-079fa2fbe196-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d4fbc0ba-e782-4108-960d-5c33483baf4a tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "cinder-2fe21be9-d083-4915-b9aa-b62a18d5be31-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d4fbc0ba-e782-4108-960d-5c33483baf4a tempest-CreateVolumesFromImageTest-1062767329 None] Lock "cinder-2fe21be9-d083-4915-b9aa-b62a18d5be31-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d4fbc0ba-e782-4108-960d-5c33483baf4a tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "cinder-quobyte-2fe21be9-d083-4915-b9aa-b62a18d5be31" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d4fbc0ba-e782-4108-960d-5c33483baf4a tempest-CreateVolumesFromImageTest-1062767329 None] Lock "cinder-quobyte-2fe21be9-d083-4915-b9aa-b62a18d5be31" acquired by "delete_volume" :: waited 0.014s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:18 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d5217c-4e16-4c0e-a869-29bf3b56b192]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:49:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d4fbc0ba-e782-4108-960d-5c33483baf4a tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2fe21be9-d083-4915-b9aa-b62a18d5be31 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:19 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2fe21be9-d083-4915-b9aa-b62a18d5be31 Nov 06 18:49:19 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:19 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d4fbc0ba-e782-4108-960d-5c33483baf4a tempest-CreateVolumesFromImageTest-1062767329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2fe21be9-d083-4915-b9aa-b62a18d5be31" returned: 0 in 0.384s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d4fbc0ba-e782-4108-960d-5c33483baf4a tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2fe21be9-d083-4915-b9aa-b62a18d5be31 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:19 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2fe21be9-d083-4915-b9aa-b62a18d5be31 Nov 06 18:49:19 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Flow 'volume_create_manager' (f737b2cb-90d7-4051-a787-1bbf6be0dda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef407079-fe09-4f41-b03a-8cccf534e40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef407079-fe09-4f41-b03a-8cccf534e40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1111648302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6ada00b-3343-449a-904d-d7355755a9a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0dbd15a35f4a169dde3d16f6781a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ffc46989-24fb-4c40-99fe-370f8dc54f47,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:19Z,use_quota=True,user_id='cd4f51027fbd46c38534817e952255e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd4a301-2f60-40ec-8893-10c045915650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd4a301-2f60-40ec-8893-10c045915650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84820e33-5760-4f34-95d7-e0e6bb92eb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84820e33-5760-4f34-95d7-e0e6bb92eb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd6ada00b-3343-449a-904d-d7355755a9a0', 'volume_name': 'volume-d6ada00b-3343-449a-904d-d7355755a9a0', 'volume_size': 1, 'snapshot_id': 'ffc46989-24fb-4c40-99fe-370f8dc54f47'}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4c9d57-43ba-4d86-bac1-3ad49e6a2591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4c9d57-43ba-4d86-bac1-3ad49e6a2591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:19 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3973da75-cc8b-4edb-aa90-41a2b7bdb7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:19 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Volume d6ada00b-3343-449a-904d-d7355755a9a0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d6ada00b-3343-449a-904d-d7355755a9a0', 'volume_size': 1, 'snapshot_id': 'ffc46989-24fb-4c40-99fe-370f8dc54f47'} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d4fbc0ba-e782-4108-960d-5c33483baf4a tempest-CreateVolumesFromImageTest-1062767329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2fe21be9-d083-4915-b9aa-b62a18d5be31" returned: 0 in 0.294s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Acquiring lock "cinder-quobyte-ffc46989-24fb-4c40-99fe-370f8dc54f47-d6ada00b-3343-449a-904d-d7355755a9a0" by "_create_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d4fbc0ba-e782-4108-960d-5c33483baf4a tempest-CreateVolumesFromImageTest-1062767329 None] Lock "cinder-quobyte-2fe21be9-d083-4915-b9aa-b62a18d5be31" released by "delete_volume" :: held 0.737s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Lock "cinder-quobyte-ffc46989-24fb-4c40-99fe-370f8dc54f47-d6ada00b-3343-449a-904d-d7355755a9a0" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Creating volume d6ada00b-3343-449a-904d-d7355755a9a0 from snapshot ffc46989-24fb-4c40-99fe-370f8dc54f47 {{(pid=86794) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Acquiring lock "cinder-quobyte-d6ada00b-3343-449a-904d-d7355755a9a0" by "_copy_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Lock "cinder-quobyte-d6ada00b-3343-449a-904d-d7355755a9a0" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] snapshot: ffc46989-24fb-4c40-99fe-370f8dc54f47, volume: d6ada00b-3343-449a-904d-d7355755a9a0, {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6e6237-1e3a-4016-9f02-5de062458237]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-d4fbc0ba-e782-4108-960d-5c33483baf4a tempest-CreateVolumesFromImageTest-1062767329 None] Created reservations ['884c9237-aadd-4f5c-9538-491d4505313b', '9e76c23c-96b7-4e53-9062-e72eab1882a7', '09f58f1e-c55d-4203-9d98-2cc2df1ea3e0', 'ba5c8938-0828-4923-bd73-4d273c0eed1a'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d4fbc0ba-e782-4108-960d-5c33483baf4a tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d4fbc0ba-e782-4108-960d-5c33483baf4a tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d4fbc0ba-e782-4108-960d-5c33483baf4a tempest-CreateVolumesFromImageTest-1062767329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d4fbc0ba-e782-4108-960d-5c33483baf4a tempest-CreateVolumesFromImageTest-1062767329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d4fbc0ba-e782-4108-960d-5c33483baf4a tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d4fbc0ba-e782-4108-960d-5c33483baf4a tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:19 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47 Nov 06 18:49:19 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:19 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:49:19 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-94fdc2e5-14e3-4ea3-bd5c-c49d4ef3adfd tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "cinder-3643a9b6-a81b-4eeb-b4c7-ff403f764926-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-94fdc2e5-14e3-4ea3-bd5c-c49d4ef3adfd tempest-CreateVolumesFromImageTest-1062767329 None] Lock "cinder-3643a9b6-a81b-4eeb-b4c7-ff403f764926-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-94fdc2e5-14e3-4ea3-bd5c-c49d4ef3adfd tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "cinder-quobyte-3643a9b6-a81b-4eeb-b4c7-ff403f764926" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:20 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-94fdc2e5-14e3-4ea3-bd5c-c49d4ef3adfd tempest-CreateVolumesFromImageTest-1062767329 None] Lock "cinder-quobyte-3643a9b6-a81b-4eeb-b4c7-ff403f764926" acquired by "delete_volume" :: waited 0.017s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d4fbc0ba-e782-4108-960d-5c33483baf4a tempest-CreateVolumesFromImageTest-1062767329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.315s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-d4fbc0ba-e782-4108-960d-5c33483baf4a tempest-CreateVolumesFromImageTest-1062767329 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:49:20 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-d4fbc0ba-e782-4108-960d-5c33483baf4a tempest-CreateVolumesFromImageTest-1062767329 None] Deleted volume successfully. Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89d876d-7b14-426b-8416-35352068681a]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94fdc2e5-14e3-4ea3-bd5c-c49d4ef3adfd tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3643a9b6-a81b-4eeb-b4c7-ff403f764926 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d4fbc0ba-e782-4108-960d-5c33483baf4a tempest-CreateVolumesFromImageTest-1062767329 None] Lock "cinder-2fe21be9-d083-4915-b9aa-b62a18d5be31-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:20 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47" returned: 0 in 0.502s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a519d641-55e3-4e32-ac8b-8ad4c2723ce9]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:20 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3643a9b6-a81b-4eeb-b4c7-ff403f764926 Nov 06 18:49:20 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:20 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a Nov 06 18:49:20 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:20 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94fdc2e5-14e3-4ea3-bd5c-c49d4ef3adfd tempest-CreateVolumesFromImageTest-1062767329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3643a9b6-a81b-4eeb-b4c7-ff403f764926" returned: 0 in 0.434s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94fdc2e5-14e3-4ea3-bd5c-c49d4ef3adfd tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3643a9b6-a81b-4eeb-b4c7-ff403f764926 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:20 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3643a9b6-a81b-4eeb-b4c7-ff403f764926 Nov 06 18:49:20 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:20 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a" returned: 0 in 0.442s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Creating direct copy from snapshot {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG cinder.utils [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Path /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d6ada00b-3343-449a-904d-d7355755a9a0 not found in is_blk_device check {{(pid=86794) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d6ada00b-3343-449a-904d-d7355755a9a0 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:20 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d6ada00b-3343-449a-904d-d7355755a9a0 Nov 06 18:49:20 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:20 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94fdc2e5-14e3-4ea3-bd5c-c49d4ef3adfd tempest-CreateVolumesFromImageTest-1062767329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3643a9b6-a81b-4eeb-b4c7-ff403f764926" returned: 0 in 0.272s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-94fdc2e5-14e3-4ea3-bd5c-c49d4ef3adfd tempest-CreateVolumesFromImageTest-1062767329 None] Lock "cinder-quobyte-3643a9b6-a81b-4eeb-b4c7-ff403f764926" released by "delete_volume" :: held 0.769s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:20 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-94fdc2e5-14e3-4ea3-bd5c-c49d4ef3adfd tempest-CreateVolumesFromImageTest-1062767329 None] Created reservations ['264c6e30-2c10-4711-9815-dc5ad9d6902e', 'f03f1c6b-09a4-4e01-9b2a-f7e96ee969a0', '0c350981-638d-4bf5-89ff-946a2d7d4dfb', 'ad895afd-55aa-4fe4-a72f-b610abf59f1d'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:49:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-94fdc2e5-14e3-4ea3-bd5c-c49d4ef3adfd tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-94fdc2e5-14e3-4ea3-bd5c-c49d4ef3adfd tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-94fdc2e5-14e3-4ea3-bd5c-c49d4ef3adfd tempest-CreateVolumesFromImageTest-1062767329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-94fdc2e5-14e3-4ea3-bd5c-c49d4ef3adfd tempest-CreateVolumesFromImageTest-1062767329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-94fdc2e5-14e3-4ea3-bd5c-c49d4ef3adfd tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94fdc2e5-14e3-4ea3-bd5c-c49d4ef3adfd tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:21 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:49:21 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1016ed39-9f36-4058-ac99-f804e4a63a91 tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "cinder-c470c666-945d-4d47-8d16-d21fa205e232-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1016ed39-9f36-4058-ac99-f804e4a63a91 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "cinder-c470c666-945d-4d47-8d16-d21fa205e232-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1016ed39-9f36-4058-ac99-f804e4a63a91 tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "cinder-quobyte-c470c666-945d-4d47-8d16-d21fa205e232" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1016ed39-9f36-4058-ac99-f804e4a63a91 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "cinder-quobyte-c470c666-945d-4d47-8d16-d21fa205e232" acquired by "delete_volume" :: waited 0.033s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:21 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd047cbf-1278-44fe-813f-04c1d2ee310f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:49:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1016ed39-9f36-4058-ac99-f804e4a63a91 tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c470c666-945d-4d47-8d16-d21fa205e232 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:21 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94fdc2e5-14e3-4ea3-bd5c-c49d4ef3adfd tempest-CreateVolumesFromImageTest-1062767329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.414s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:21 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-94fdc2e5-14e3-4ea3-bd5c-c49d4ef3adfd tempest-CreateVolumesFromImageTest-1062767329 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:49:21 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-94fdc2e5-14e3-4ea3-bd5c-c49d4ef3adfd tempest-CreateVolumesFromImageTest-1062767329 None] Deleted volume successfully. Nov 06 18:49:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-94fdc2e5-14e3-4ea3-bd5c-c49d4ef3adfd tempest-CreateVolumesFromImageTest-1062767329 None] Lock "cinder-3643a9b6-a81b-4eeb-b4c7-ff403f764926-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:21 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c470c666-945d-4d47-8d16-d21fa205e232 Nov 06 18:49:21 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:22 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1016ed39-9f36-4058-ac99-f804e4a63a91 tempest-CreateVolumesFromImageTest-1062767329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c470c666-945d-4d47-8d16-d21fa205e232" returned: 0 in 0.732s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1016ed39-9f36-4058-ac99-f804e4a63a91 tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c470c666-945d-4d47-8d16-d21fa205e232 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:22 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c470c666-945d-4d47-8d16-d21fa205e232 Nov 06 18:49:22 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:22 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1016ed39-9f36-4058-ac99-f804e4a63a91 tempest-CreateVolumesFromImageTest-1062767329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c470c666-945d-4d47-8d16-d21fa205e232" returned: 0 in 0.471s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1016ed39-9f36-4058-ac99-f804e4a63a91 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "cinder-quobyte-c470c666-945d-4d47-8d16-d21fa205e232" released by "delete_volume" :: held 1.335s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:22 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-1016ed39-9f36-4058-ac99-f804e4a63a91 tempest-CreateVolumesFromImageTest-1062767329 None] Created reservations ['2fed468a-9004-4a16-8b0e-16d515ad2f6c', '52c264d6-d82b-4729-82e1-5814234257ea', '28468fca-565f-4071-989f-121e2ecaedb7', '8d7a1327-29df-4166-939b-b140bf337f6c'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:49:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1016ed39-9f36-4058-ac99-f804e4a63a91 tempest-CreateVolumesFromImageTest-1062767329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1016ed39-9f36-4058-ac99-f804e4a63a91 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:22 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1016ed39-9f36-4058-ac99-f804e4a63a91 tempest-CreateVolumesFromImageTest-1062767329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:22 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1016ed39-9f36-4058-ac99-f804e4a63a91 tempest-CreateVolumesFromImageTest-1062767329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1016ed39-9f36-4058-ac99-f804e4a63a91 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1016ed39-9f36-4058-ac99-f804e4a63a91 tempest-CreateVolumesFromImageTest-1062767329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:23 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:49:23 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:23 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1016ed39-9f36-4058-ac99-f804e4a63a91 tempest-CreateVolumesFromImageTest-1062767329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.389s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:23 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-1016ed39-9f36-4058-ac99-f804e4a63a91 tempest-CreateVolumesFromImageTest-1062767329 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:49:23 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-1016ed39-9f36-4058-ac99-f804e4a63a91 tempest-CreateVolumesFromImageTest-1062767329 None] Deleted volume successfully. Nov 06 18:49:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1016ed39-9f36-4058-ac99-f804e4a63a91 tempest-CreateVolumesFromImageTest-1062767329 None] Lock "cinder-c470c666-945d-4d47-8d16-d21fa205e232-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:49:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:29 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:49:29 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:29 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.489s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:49:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:49:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 29 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:49:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:49:30 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d6ada00b-3343-449a-904d-d7355755a9a0" returned: 0 in 9.665s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a, size 1024.00 MB, duration 9.67 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d6ada00b-3343-449a-904d-d7355755a9a0 {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:49:30 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Converted 1024.00 MB image at 105.94 MB/s Nov 06 18:49:30 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d6ada00b-3343-449a-904d-d7355755a9a0 is being set with open permissions: ugo+rw Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d6ada00b-3343-449a-904d-d7355755a9a0 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:30 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d6ada00b-3343-449a-904d-d7355755a9a0 Nov 06 18:49:30 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Flow 'volume_create_manager' (17d894e6-bcdf-4ec7-8060-93f0a4cad0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1efb1fe2-a174-4d87-b2fc-48b085975d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1efb1fe2-a174-4d87-b2fc-48b085975d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1444510085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84211563-39fc-45e7-bdb7-b84f4ada409d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff4daf5bfb14f53bfeef57cf0461041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:31Z,use_quota=True,user_id='46f2572e09e343cc9e41b222f0202405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8345c4a-ce07-4e21-80d6-57219fb2f638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8345c4a-ce07-4e21-80d6-57219fb2f638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f22ae0-69fb-49b1-8c64-461bc6aa7849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f22ae0-69fb-49b1-8c64-461bc6aa7849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84211563-39fc-45e7-bdb7-b84f4ada409d', 'volume_name': 'volume-84211563-39fc-45e7-bdb7-b84f4ada409d', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c227c1-34c4-4f48-8c26-bab47ab20b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c227c1-34c4-4f48-8c26-bab47ab20b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fa3175-2e96-40ff-894c-f623c634276e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:30 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Volume 84211563-39fc-45e7-bdb7-b84f4ada409d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84211563-39fc-45e7-bdb7-b84f4ada409d', 'volume_size': 1} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:30 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d6ada00b-3343-449a-904d-d7355755a9a0" returned: 0 in 0.453s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Lock "cinder-quobyte-d6ada00b-3343-449a-904d-d7355755a9a0" released by "_copy_volume_from_snapshot" :: held 11.159s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Lock "cinder-quobyte-ffc46989-24fb-4c40-99fe-370f8dc54f47-d6ada00b-3343-449a-904d-d7355755a9a0" released by "_create_volume_from_snapshot" :: held 11.235s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.262s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.080s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1444510085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84211563-39fc-45e7-bdb7-b84f4ada409d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff4daf5bfb14f53bfeef57cf0461041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:31Z,use_quota=True,user_id='46f2572e09e343cc9e41b222f0202405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Creating volume 84211563-39fc-45e7-bdb7-b84f4ada409d {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:49:30 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:49:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-84211563-39fc-45e7-bdb7-b84f4ada409d 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:31 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-84211563-39fc-45e7-bdb7-b84f4ada409d 1073741824 Nov 06 18:49:31 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3973da75-cc8b-4edb-aa90-41a2b7bdb7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6ada00b-3343-449a-904d-d7355755a9a0', 'volume_size': 1, 'snapshot_id': 'ffc46989-24fb-4c40-99fe-370f8dc54f47'}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6993723-4beb-4665-b983-de4f29777ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:31 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Volume volume-d6ada00b-3343-449a-904d-d7355755a9a0 (d6ada00b-3343-449a-904d-d7355755a9a0): created successfully Nov 06 18:49:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6993723-4beb-4665-b983-de4f29777ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Flow 'volume_create_manager' (f737b2cb-90d7-4051-a787-1bbf6be0dda8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:31 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-2cd31586-de43-4e94-8450-5f4530d08243 tempest-TestStampPattern-2006903719 None] Created volume successfully. Nov 06 18:49:31 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-84211563-39fc-45e7-bdb7-b84f4ada409d 1073741824" returned: 0 in 0.810s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-84211563-39fc-45e7-bdb7-b84f4ada409d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:31 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-84211563-39fc-45e7-bdb7-b84f4ada409d Nov 06 18:49:31 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:32 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-84211563-39fc-45e7-bdb7-b84f4ada409d" returned: 0 in 0.297s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:32 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:49:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fa3175-2e96-40ff-894c-f623c634276e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84211563-39fc-45e7-bdb7-b84f4ada409d', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0084dca-123c-42b0-b583-413329379a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:32 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Volume volume-84211563-39fc-45e7-bdb7-b84f4ada409d (84211563-39fc-45e7-bdb7-b84f4ada409d): created successfully Nov 06 18:49:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0084dca-123c-42b0-b583-413329379a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Flow 'volume_create_manager' (17d894e6-bcdf-4ec7-8060-93f0a4cad0c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:32 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-583e65cf-19e7-452b-ac6a-b33a31d26602 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Created volume successfully. Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Flow 'volume_create_manager' (c7d1be12-d29c-48b2-8850-fea2a39645db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5c316f-953b-4fb5-b1df-cecfbb47d1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5c316f-953b-4fb5-b1df-cecfbb47d1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-483617207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b86012e-74fb-46c1-8a2c-100a705f2f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff4daf5bfb14f53bfeef57cf0461041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:33Z,use_quota=True,user_id='46f2572e09e343cc9e41b222f0202405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344bc3f9-8a09-4521-a429-c97b00328617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344bc3f9-8a09-4521-a429-c97b00328617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f31dca-0bc7-46c4-9c29-ae781409b37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f31dca-0bc7-46c4-9c29-ae781409b37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b86012e-74fb-46c1-8a2c-100a705f2f06', 'volume_name': 'volume-8b86012e-74fb-46c1-8a2c-100a705f2f06', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a398e4d-cf72-4de0-bed3-e07036d09579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a398e4d-cf72-4de0-bed3-e07036d09579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d26262-2a80-44a1-a96c-d7b96979fdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:33 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Volume 8b86012e-74fb-46c1-8a2c-100a705f2f06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b86012e-74fb-46c1-8a2c-100a705f2f06', 'volume_size': 1} Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-483617207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b86012e-74fb-46c1-8a2c-100a705f2f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff4daf5bfb14f53bfeef57cf0461041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:33Z,use_quota=True,user_id='46f2572e09e343cc9e41b222f0202405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Creating volume 8b86012e-74fb-46c1-8a2c-100a705f2f06 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:49:33 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:49:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8b86012e-74fb-46c1-8a2c-100a705f2f06 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:33 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8b86012e-74fb-46c1-8a2c-100a705f2f06 1073741824 Nov 06 18:49:33 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Flow 'volume_create_manager' (c361023e-54a9-4fdf-9f99-1386eeb58d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0e852b-378f-41b1-a586-ec5cdb2b31e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0e852b-378f-41b1-a586-ec5cdb2b31e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-245731903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff4daf5bfb14f53bfeef57cf0461041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:34Z,use_quota=True,user_id='46f2572e09e343cc9e41b222f0202405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c95265-df74-489f-8fe5-e35051875adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c95265-df74-489f-8fe5-e35051875adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df456fc-f2fe-4179-961e-52d2ebd6e949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df456fc-f2fe-4179-961e-52d2ebd6e949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9', 'volume_name': 'volume-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa5ccc3-35e4-4af6-95ee-f9285c9e74a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa5ccc3-35e4-4af6-95ee-f9285c9e74a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61cdd37d-caa2-41e4-95e0-6c8b7f2f72f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:34 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Volume 2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9', 'volume_size': 1} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:34 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8b86012e-74fb-46c1-8a2c-100a705f2f06 1073741824" returned: 0 in 0.782s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8b86012e-74fb-46c1-8a2c-100a705f2f06 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:34 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8b86012e-74fb-46c1-8a2c-100a705f2f06 Nov 06 18:49:34 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Flow 'volume_create_manager' (ab851603-33f7-48ed-a398-5d2bee48f6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d56d3c4-1634-4077-8761-55af1dffa23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d56d3c4-1634-4077-8761-55af1dffa23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2051048343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27d59c7-834e-4c1f-8081-1e73024a9f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff4daf5bfb14f53bfeef57cf0461041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:34Z,use_quota=True,user_id='46f2572e09e343cc9e41b222f0202405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc07ee1-76d9-4d36-9f06-78658f322404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc07ee1-76d9-4d36-9f06-78658f322404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (385058d4-4b28-4b4e-805e-ce29cfbb1a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (385058d4-4b28-4b4e-805e-ce29cfbb1a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a27d59c7-834e-4c1f-8081-1e73024a9f62', 'volume_name': 'volume-a27d59c7-834e-4c1f-8081-1e73024a9f62', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021bc338-d058-4e20-a9d4-b9fa502509b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021bc338-d058-4e20-a9d4-b9fa502509b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2016d57-bf0d-496c-95ae-58b44591f688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:34 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Volume a27d59c7-834e-4c1f-8081-1e73024a9f62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a27d59c7-834e-4c1f-8081-1e73024a9f62', 'volume_size': 1} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:34 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8b86012e-74fb-46c1-8a2c-100a705f2f06" returned: 0 in 0.518s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.712s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-245731903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff4daf5bfb14f53bfeef57cf0461041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:34Z,use_quota=True,user_id='46f2572e09e343cc9e41b222f0202405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Creating volume 2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:49:34 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:34 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9 1073741824 Nov 06 18:49:34 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d26262-2a80-44a1-a96c-d7b96979fdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b86012e-74fb-46c1-8a2c-100a705f2f06', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926b1d38-9370-48c7-b232-bcd384ac4596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:35 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Volume volume-8b86012e-74fb-46c1-8a2c-100a705f2f06 (8b86012e-74fb-46c1-8a2c-100a705f2f06): created successfully Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926b1d38-9370-48c7-b232-bcd384ac4596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Flow 'volume_create_manager' (c7d1be12-d29c-48b2-8850-fea2a39645db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:35 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a3c92848-6057-4ac0-8497-18e570f5bb58 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Created volume successfully. Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Flow 'volume_create_manager' (5b4f214e-f889-4fbd-be33-66f8a13ee639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb13d3ae-0d3f-4c49-bbfb-789d24beee68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb13d3ae-0d3f-4c49-bbfb-789d24beee68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-315047896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988a9f79-3772-48b2-9b3e-59c84637f0a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff4daf5bfb14f53bfeef57cf0461041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:35Z,use_quota=True,user_id='46f2572e09e343cc9e41b222f0202405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e163b62a-a00b-42eb-9002-c3f89d41e768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e163b62a-a00b-42eb-9002-c3f89d41e768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8303e6e0-bada-4401-a67d-337fa1707f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8303e6e0-bada-4401-a67d-337fa1707f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '988a9f79-3772-48b2-9b3e-59c84637f0a8', 'volume_name': 'volume-988a9f79-3772-48b2-9b3e-59c84637f0a8', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e7b86c-dda7-4162-88f9-b09382d9aefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e7b86c-dda7-4162-88f9-b09382d9aefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06940130-089b-438c-90b9-bc63f5d88c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:35 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Volume 988a9f79-3772-48b2-9b3e-59c84637f0a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-988a9f79-3772-48b2-9b3e-59c84637f0a8', 'volume_size': 1} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Flow 'volume_create_manager' (88e7a848-6edd-4dd5-89e1-925846147060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a5c79f7-3e50-4da3-81f4-79bc54b7ff24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a5c79f7-3e50-4da3-81f4-79bc54b7ff24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-247915030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ea23b3-749f-4d42-bced-306added39e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff4daf5bfb14f53bfeef57cf0461041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:35Z,use_quota=True,user_id='46f2572e09e343cc9e41b222f0202405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd36fea-af10-4e09-b857-80f5a07d2a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd36fea-af10-4e09-b857-80f5a07d2a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0829061b-4e9c-4d7e-ae18-adc6890001fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0829061b-4e9c-4d7e-ae18-adc6890001fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26ea23b3-749f-4d42-bced-306added39e8', 'volume_name': 'volume-26ea23b3-749f-4d42-bced-306added39e8', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1a0b5c-f5df-42ef-b60c-3ec95dd0e8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1a0b5c-f5df-42ef-b60c-3ec95dd0e8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ac160f-bc62-4047-9519-be0a5fcc1281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:35 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Volume 26ea23b3-749f-4d42-bced-306added39e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26ea23b3-749f-4d42-bced-306added39e8', 'volume_size': 1} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:35 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9 1073741824" returned: 0 in 0.693s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:35 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9 Nov 06 18:49:35 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:35 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9" returned: 0 in 0.269s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.158s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2051048343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27d59c7-834e-4c1f-8081-1e73024a9f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff4daf5bfb14f53bfeef57cf0461041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:34Z,use_quota=True,user_id='46f2572e09e343cc9e41b222f0202405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Creating volume a27d59c7-834e-4c1f-8081-1e73024a9f62 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:49:35 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a27d59c7-834e-4c1f-8081-1e73024a9f62 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61cdd37d-caa2-41e4-95e0-6c8b7f2f72f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953a140f-9ced-426e-8ac1-db9d6559b326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:35 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a27d59c7-834e-4c1f-8081-1e73024a9f62 1073741824 Nov 06 18:49:35 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:35 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Volume volume-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9 (2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9): created successfully Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953a140f-9ced-426e-8ac1-db9d6559b326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Flow 'volume_create_manager' (c361023e-54a9-4fdf-9f99-1386eeb58d4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:36 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-381fa6e5-329f-46c2-8709-a1c55515c582 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Created volume successfully. Nov 06 18:49:36 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a27d59c7-834e-4c1f-8081-1e73024a9f62 1073741824" returned: 0 in 0.575s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a27d59c7-834e-4c1f-8081-1e73024a9f62 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:36 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a27d59c7-834e-4c1f-8081-1e73024a9f62 Nov 06 18:49:36 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:36 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a27d59c7-834e-4c1f-8081-1e73024a9f62" returned: 0 in 0.269s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:49:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.531s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-315047896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988a9f79-3772-48b2-9b3e-59c84637f0a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff4daf5bfb14f53bfeef57cf0461041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:35Z,use_quota=True,user_id='46f2572e09e343cc9e41b222f0202405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:49:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Creating volume 988a9f79-3772-48b2-9b3e-59c84637f0a8 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:49:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:49:36 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:49:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-988a9f79-3772-48b2-9b3e-59c84637f0a8 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2016d57-bf0d-496c-95ae-58b44591f688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a27d59c7-834e-4c1f-8081-1e73024a9f62', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f481ad-71e3-4ec0-b885-00800992f1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:36 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-988a9f79-3772-48b2-9b3e-59c84637f0a8 1073741824 Nov 06 18:49:36 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:36 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Volume volume-a27d59c7-834e-4c1f-8081-1e73024a9f62 (a27d59c7-834e-4c1f-8081-1e73024a9f62): created successfully Nov 06 18:49:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f481ad-71e3-4ec0-b885-00800992f1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Flow 'volume_create_manager' (ab851603-33f7-48ed-a398-5d2bee48f6d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:36 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-9297a072-b7f8-471b-a8ee-fe4a4063b224 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Created volume successfully. Nov 06 18:49:37 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-988a9f79-3772-48b2-9b3e-59c84637f0a8 1073741824" returned: 0 in 0.464s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-988a9f79-3772-48b2-9b3e-59c84637f0a8 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:37 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-988a9f79-3772-48b2-9b3e-59c84637f0a8 Nov 06 18:49:37 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:37 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-988a9f79-3772-48b2-9b3e-59c84637f0a8" returned: 0 in 0.247s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:49:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.027s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-247915030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ea23b3-749f-4d42-bced-306added39e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff4daf5bfb14f53bfeef57cf0461041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:49:35Z,use_quota=True,user_id='46f2572e09e343cc9e41b222f0202405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:49:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Creating volume 26ea23b3-749f-4d42-bced-306added39e8 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:49:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:49:37 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:49:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-26ea23b3-749f-4d42-bced-306added39e8 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:37 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-26ea23b3-749f-4d42-bced-306added39e8 1073741824 Nov 06 18:49:37 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06940130-089b-438c-90b9-bc63f5d88c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-988a9f79-3772-48b2-9b3e-59c84637f0a8', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58133745-182e-4bf5-bc1d-720a5f70b53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:37 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Volume volume-988a9f79-3772-48b2-9b3e-59c84637f0a8 (988a9f79-3772-48b2-9b3e-59c84637f0a8): created successfully Nov 06 18:49:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58133745-182e-4bf5-bc1d-720a5f70b53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Flow 'volume_create_manager' (5b4f214e-f889-4fbd-be33-66f8a13ee639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:37 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-50366738-9952-4f11-bf5d-07f7638bd7e4 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Created volume successfully. Nov 06 18:49:37 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-26ea23b3-749f-4d42-bced-306added39e8 1073741824" returned: 0 in 0.405s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-26ea23b3-749f-4d42-bced-306added39e8 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:38 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-26ea23b3-749f-4d42-bced-306added39e8 Nov 06 18:49:38 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:38 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-26ea23b3-749f-4d42-bced-306added39e8" returned: 0 in 0.242s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:49:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ac160f-bc62-4047-9519-be0a5fcc1281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26ea23b3-749f-4d42-bced-306added39e8', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59baae6-e906-4c01-a7ce-7e814908c853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:49:38 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Volume volume-26ea23b3-749f-4d42-bced-306added39e8 (26ea23b3-749f-4d42-bced-306added39e8): created successfully Nov 06 18:49:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59baae6-e906-4c01-a7ce-7e814908c853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:49:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Flow 'volume_create_manager' (88e7a848-6edd-4dd5-89e1-925846147060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:49:38 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-fe6510f6-b914-4ab9-8bd7-33b2021fcd71 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Created volume successfully. Nov 06 18:49:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a0a30be3-f569-4f73-9a13-a3f6169d5be8 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "cinder-26ea23b3-749f-4d42-bced-306added39e8-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a0a30be3-f569-4f73-9a13-a3f6169d5be8 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-26ea23b3-749f-4d42-bced-306added39e8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a0a30be3-f569-4f73-9a13-a3f6169d5be8 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "cinder-quobyte-26ea23b3-749f-4d42-bced-306added39e8" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a0a30be3-f569-4f73-9a13-a3f6169d5be8 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-quobyte-26ea23b3-749f-4d42-bced-306added39e8" acquired by "delete_volume" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:38 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce27af93-3430-44f9-bcb1-c18ba43b5dea]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:49:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a0a30be3-f569-4f73-9a13-a3f6169d5be8 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-26ea23b3-749f-4d42-bced-306added39e8 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:38 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-26ea23b3-749f-4d42-bced-306added39e8 Nov 06 18:49:38 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:39 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a0a30be3-f569-4f73-9a13-a3f6169d5be8 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-26ea23b3-749f-4d42-bced-306added39e8" returned: 0 in 0.370s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a0a30be3-f569-4f73-9a13-a3f6169d5be8 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-26ea23b3-749f-4d42-bced-306added39e8 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:39 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-26ea23b3-749f-4d42-bced-306added39e8 Nov 06 18:49:39 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:39 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a0a30be3-f569-4f73-9a13-a3f6169d5be8 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-26ea23b3-749f-4d42-bced-306added39e8" returned: 0 in 0.284s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a0a30be3-f569-4f73-9a13-a3f6169d5be8 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-quobyte-26ea23b3-749f-4d42-bced-306added39e8" released by "delete_volume" :: held 0.702s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:39 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-a0a30be3-f569-4f73-9a13-a3f6169d5be8 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Created reservations ['64def089-c73d-4018-9d69-5f8c0a0bb77d', '1a1115d7-1430-4542-8936-cb2775a3eaf4', '9157ca89-21fa-49ef-9442-6a7a50bc9119', '4473a82e-1db5-47ad-9b5c-9968b5ef59e8'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:49:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a0a30be3-f569-4f73-9a13-a3f6169d5be8 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a0a30be3-f569-4f73-9a13-a3f6169d5be8 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a0a30be3-f569-4f73-9a13-a3f6169d5be8 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a0a30be3-f569-4f73-9a13-a3f6169d5be8 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a0a30be3-f569-4f73-9a13-a3f6169d5be8 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a0a30be3-f569-4f73-9a13-a3f6169d5be8 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:39 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:49:39 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a7fdd77c-233c-4726-b6cb-c2e2b216ac7e tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "cinder-988a9f79-3772-48b2-9b3e-59c84637f0a8-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:39 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a0a30be3-f569-4f73-9a13-a3f6169d5be8 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.280s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:39 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-a0a30be3-f569-4f73-9a13-a3f6169d5be8 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:49:39 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a0a30be3-f569-4f73-9a13-a3f6169d5be8 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Deleted volume successfully. Nov 06 18:49:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a7fdd77c-233c-4726-b6cb-c2e2b216ac7e tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-988a9f79-3772-48b2-9b3e-59c84637f0a8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a0a30be3-f569-4f73-9a13-a3f6169d5be8 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-26ea23b3-749f-4d42-bced-306added39e8-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a7fdd77c-233c-4726-b6cb-c2e2b216ac7e tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "cinder-quobyte-988a9f79-3772-48b2-9b3e-59c84637f0a8" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a7fdd77c-233c-4726-b6cb-c2e2b216ac7e tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-quobyte-988a9f79-3772-48b2-9b3e-59c84637f0a8" acquired by "delete_volume" :: waited 0.018s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:40 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[db29b93b-3d7c-4b86-8688-340bb91ceb70]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:49:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a7fdd77c-233c-4726-b6cb-c2e2b216ac7e tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-988a9f79-3772-48b2-9b3e-59c84637f0a8 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:40 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-988a9f79-3772-48b2-9b3e-59c84637f0a8 Nov 06 18:49:40 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:40 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a7fdd77c-233c-4726-b6cb-c2e2b216ac7e tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-988a9f79-3772-48b2-9b3e-59c84637f0a8" returned: 0 in 0.361s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a7fdd77c-233c-4726-b6cb-c2e2b216ac7e tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-988a9f79-3772-48b2-9b3e-59c84637f0a8 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:40 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-988a9f79-3772-48b2-9b3e-59c84637f0a8 Nov 06 18:49:40 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:40 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a7fdd77c-233c-4726-b6cb-c2e2b216ac7e tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-988a9f79-3772-48b2-9b3e-59c84637f0a8" returned: 0 in 0.251s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a7fdd77c-233c-4726-b6cb-c2e2b216ac7e tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-quobyte-988a9f79-3772-48b2-9b3e-59c84637f0a8" released by "delete_volume" :: held 0.656s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:40 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-a7fdd77c-233c-4726-b6cb-c2e2b216ac7e tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Created reservations ['de9a8c9a-ff50-4089-a901-91e20b521857', '6849479c-a9c1-4f00-9326-d69c85b800f7', '3e6824d4-61d3-4a90-914c-b997cb6923ba', '58453b3d-1c0d-4dd8-aedc-697f5c13e456'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:49:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a7fdd77c-233c-4726-b6cb-c2e2b216ac7e tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a7fdd77c-233c-4726-b6cb-c2e2b216ac7e tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a7fdd77c-233c-4726-b6cb-c2e2b216ac7e tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a7fdd77c-233c-4726-b6cb-c2e2b216ac7e tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a7fdd77c-233c-4726-b6cb-c2e2b216ac7e tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a7fdd77c-233c-4726-b6cb-c2e2b216ac7e tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:40 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:49:40 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:41 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a7fdd77c-233c-4726-b6cb-c2e2b216ac7e tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.265s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:41 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-a7fdd77c-233c-4726-b6cb-c2e2b216ac7e tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:49:41 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a7fdd77c-233c-4726-b6cb-c2e2b216ac7e tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Deleted volume successfully. Nov 06 18:49:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a7fdd77c-233c-4726-b6cb-c2e2b216ac7e tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-988a9f79-3772-48b2-9b3e-59c84637f0a8-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4c08e917-99e1-4028-94af-62593d0af8ff tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "cinder-a27d59c7-834e-4c1f-8081-1e73024a9f62-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4c08e917-99e1-4028-94af-62593d0af8ff tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-a27d59c7-834e-4c1f-8081-1e73024a9f62-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4c08e917-99e1-4028-94af-62593d0af8ff tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "cinder-quobyte-a27d59c7-834e-4c1f-8081-1e73024a9f62" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4c08e917-99e1-4028-94af-62593d0af8ff tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-quobyte-a27d59c7-834e-4c1f-8081-1e73024a9f62" acquired by "delete_volume" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:41 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7d015a-d943-405e-8dbb-2709409a9791]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:49:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4c08e917-99e1-4028-94af-62593d0af8ff tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a27d59c7-834e-4c1f-8081-1e73024a9f62 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:41 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a27d59c7-834e-4c1f-8081-1e73024a9f62 Nov 06 18:49:41 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:41 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4c08e917-99e1-4028-94af-62593d0af8ff tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a27d59c7-834e-4c1f-8081-1e73024a9f62" returned: 0 in 0.346s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4c08e917-99e1-4028-94af-62593d0af8ff tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a27d59c7-834e-4c1f-8081-1e73024a9f62 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:41 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a27d59c7-834e-4c1f-8081-1e73024a9f62 Nov 06 18:49:41 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:41 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4c08e917-99e1-4028-94af-62593d0af8ff tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a27d59c7-834e-4c1f-8081-1e73024a9f62" returned: 0 in 0.244s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4c08e917-99e1-4028-94af-62593d0af8ff tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-quobyte-a27d59c7-834e-4c1f-8081-1e73024a9f62" released by "delete_volume" :: held 0.639s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:41 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-4c08e917-99e1-4028-94af-62593d0af8ff tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Created reservations ['a405cc89-fbb2-4ae2-88c7-594d239e2aa6', '894e0091-59bb-4cc1-a7fc-c5a28f712b0d', '5dc538dd-0981-43c3-8dbf-b433fbec55b7', '5d88b0db-7c19-47b3-882a-7f58d6814b5b'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:49:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4c08e917-99e1-4028-94af-62593d0af8ff tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4c08e917-99e1-4028-94af-62593d0af8ff tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4c08e917-99e1-4028-94af-62593d0af8ff tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4c08e917-99e1-4028-94af-62593d0af8ff tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4c08e917-99e1-4028-94af-62593d0af8ff tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4c08e917-99e1-4028-94af-62593d0af8ff tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:41 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:49:41 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:42 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4c08e917-99e1-4028-94af-62593d0af8ff tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.242s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:42 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-4c08e917-99e1-4028-94af-62593d0af8ff tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:49:42 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-4c08e917-99e1-4028-94af-62593d0af8ff tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Deleted volume successfully. Nov 06 18:49:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4c08e917-99e1-4028-94af-62593d0af8ff tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-a27d59c7-834e-4c1f-8081-1e73024a9f62-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-48a91608-ed69-4dae-9317-14ae81549462 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "cinder-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-48a91608-ed69-4dae-9317-14ae81549462 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-48a91608-ed69-4dae-9317-14ae81549462 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "cinder-quobyte-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-48a91608-ed69-4dae-9317-14ae81549462 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-quobyte-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9" acquired by "delete_volume" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:42 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab8427f-9d58-4fd8-83df-e27b43dcfb00]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:49:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-48a91608-ed69-4dae-9317-14ae81549462 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:42 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9 Nov 06 18:49:42 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:42 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-48a91608-ed69-4dae-9317-14ae81549462 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9" returned: 0 in 0.382s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-48a91608-ed69-4dae-9317-14ae81549462 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:42 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9 Nov 06 18:49:42 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:43 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-48a91608-ed69-4dae-9317-14ae81549462 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9" returned: 0 in 0.267s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-48a91608-ed69-4dae-9317-14ae81549462 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-quobyte-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9" released by "delete_volume" :: held 0.694s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:43 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-48a91608-ed69-4dae-9317-14ae81549462 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Created reservations ['f19f2a8e-bcbf-4ce5-8155-98e51ae5d6a9', '911365d0-7076-4a6d-a658-02de8396de34', 'd4f8dcaa-342d-4c09-a648-bff0f2cd1d30', 'ea4408f0-6e37-4087-b0b5-b73929a88f9f'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:49:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-48a91608-ed69-4dae-9317-14ae81549462 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-48a91608-ed69-4dae-9317-14ae81549462 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:43 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-48a91608-ed69-4dae-9317-14ae81549462 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:43 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-48a91608-ed69-4dae-9317-14ae81549462 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-48a91608-ed69-4dae-9317-14ae81549462 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-48a91608-ed69-4dae-9317-14ae81549462 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:43 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:49:43 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7ed1f76f-1d90-4487-91a3-d82092b52f03 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "cinder-8b86012e-74fb-46c1-8a2c-100a705f2f06-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:43 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-48a91608-ed69-4dae-9317-14ae81549462 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.283s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:43 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-48a91608-ed69-4dae-9317-14ae81549462 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:49:43 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-48a91608-ed69-4dae-9317-14ae81549462 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Deleted volume successfully. Nov 06 18:49:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7ed1f76f-1d90-4487-91a3-d82092b52f03 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-8b86012e-74fb-46c1-8a2c-100a705f2f06-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-48a91608-ed69-4dae-9317-14ae81549462 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-2b5a8461-0c6c-43d4-8bb7-8d5c84b844c9-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7ed1f76f-1d90-4487-91a3-d82092b52f03 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "cinder-quobyte-8b86012e-74fb-46c1-8a2c-100a705f2f06" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7ed1f76f-1d90-4487-91a3-d82092b52f03 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-quobyte-8b86012e-74fb-46c1-8a2c-100a705f2f06" acquired by "delete_volume" :: waited 0.018s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:43 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[634c0dfe-406c-44ce-be04-2f8de1abd652]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:49:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7ed1f76f-1d90-4487-91a3-d82092b52f03 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8b86012e-74fb-46c1-8a2c-100a705f2f06 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:43 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8b86012e-74fb-46c1-8a2c-100a705f2f06 Nov 06 18:49:43 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:43 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7ed1f76f-1d90-4487-91a3-d82092b52f03 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8b86012e-74fb-46c1-8a2c-100a705f2f06" returned: 0 in 0.368s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7ed1f76f-1d90-4487-91a3-d82092b52f03 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8b86012e-74fb-46c1-8a2c-100a705f2f06 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:44 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8b86012e-74fb-46c1-8a2c-100a705f2f06 Nov 06 18:49:44 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:44 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7ed1f76f-1d90-4487-91a3-d82092b52f03 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8b86012e-74fb-46c1-8a2c-100a705f2f06" returned: 0 in 0.257s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7ed1f76f-1d90-4487-91a3-d82092b52f03 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-quobyte-8b86012e-74fb-46c1-8a2c-100a705f2f06" released by "delete_volume" :: held 0.663s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:44 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-7ed1f76f-1d90-4487-91a3-d82092b52f03 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Created reservations ['ac0e5ab5-7802-49c5-811f-294a78c2fe3a', '133a6aa8-e7fe-48ce-bee5-262b94a9959f', '716d3439-5ed8-4cd5-8b69-84b221a06bcb', '719b03ce-0cd0-4983-b89a-5c4446b2f9b6'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:49:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7ed1f76f-1d90-4487-91a3-d82092b52f03 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7ed1f76f-1d90-4487-91a3-d82092b52f03 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7ed1f76f-1d90-4487-91a3-d82092b52f03 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7ed1f76f-1d90-4487-91a3-d82092b52f03 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7ed1f76f-1d90-4487-91a3-d82092b52f03 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7ed1f76f-1d90-4487-91a3-d82092b52f03 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:44 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:49:44 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-13f83a2d-68fe-458a-947b-55366b15c89c tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "cinder-84211563-39fc-45e7-bdb7-b84f4ada409d-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-13f83a2d-68fe-458a-947b-55366b15c89c tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-84211563-39fc-45e7-bdb7-b84f4ada409d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:44 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7ed1f76f-1d90-4487-91a3-d82092b52f03 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.272s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:44 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-7ed1f76f-1d90-4487-91a3-d82092b52f03 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:49:44 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-7ed1f76f-1d90-4487-91a3-d82092b52f03 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Deleted volume successfully. Nov 06 18:49:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7ed1f76f-1d90-4487-91a3-d82092b52f03 tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-8b86012e-74fb-46c1-8a2c-100a705f2f06-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-13f83a2d-68fe-458a-947b-55366b15c89c tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "cinder-quobyte-84211563-39fc-45e7-bdb7-b84f4ada409d" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:49:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-13f83a2d-68fe-458a-947b-55366b15c89c tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-quobyte-84211563-39fc-45e7-bdb7-b84f4ada409d" acquired by "delete_volume" :: waited 0.017s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:49:44 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f2bbe5-4d35-40c1-858d-9a01ce0b2123]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:49:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-13f83a2d-68fe-458a-947b-55366b15c89c tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-84211563-39fc-45e7-bdb7-b84f4ada409d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:44 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-84211563-39fc-45e7-bdb7-b84f4ada409d Nov 06 18:49:44 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:45 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-13f83a2d-68fe-458a-947b-55366b15c89c tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-84211563-39fc-45e7-bdb7-b84f4ada409d" returned: 0 in 0.357s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-13f83a2d-68fe-458a-947b-55366b15c89c tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-84211563-39fc-45e7-bdb7-b84f4ada409d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:45 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-84211563-39fc-45e7-bdb7-b84f4ada409d Nov 06 18:49:45 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:45 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-13f83a2d-68fe-458a-947b-55366b15c89c tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-84211563-39fc-45e7-bdb7-b84f4ada409d" returned: 0 in 0.247s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-13f83a2d-68fe-458a-947b-55366b15c89c tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-quobyte-84211563-39fc-45e7-bdb7-b84f4ada409d" released by "delete_volume" :: held 0.644s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:45 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-13f83a2d-68fe-458a-947b-55366b15c89c tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Created reservations ['0cbde055-10e0-47fd-9b60-14ef36e07fb7', 'b63a09fc-4c6c-435e-9959-09ddba98d3cb', 'cf06fdbd-23d5-4aca-b302-3518c1e079e4', 'e6aa3078-d90b-4ecc-b94f-b5a3f6fae09f'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:49:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-13f83a2d-68fe-458a-947b-55366b15c89c tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-13f83a2d-68fe-458a-947b-55366b15c89c tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:45 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-13f83a2d-68fe-458a-947b-55366b15c89c tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:49:45 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-13f83a2d-68fe-458a-947b-55366b15c89c tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:49:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-13f83a2d-68fe-458a-947b-55366b15c89c tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-13f83a2d-68fe-458a-947b-55366b15c89c tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:49:45 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:49:45 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:49:45 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Nov 06 18:49:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-13f83a2d-68fe-458a-947b-55366b15c89c tempest-CreateVolumesFromSourceVolumeTest-606942204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.239s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:49:45 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-13f83a2d-68fe-458a-947b-55366b15c89c tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:49:45 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-13f83a2d-68fe-458a-947b-55366b15c89c tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Deleted volume successfully. Nov 06 18:49:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-13f83a2d-68fe-458a-947b-55366b15c89c tempest-CreateVolumesFromSourceVolumeTest-606942204 None] Lock "cinder-84211563-39fc-45e7-bdb7-b84f4ada409d-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:49:55 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:UPDATE=170,cinder:SELECT=103,cinder:INSERT=37,cinder:DELETE=13 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:49:55 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=119,cinder:UPDATE=149,cinder:INSERT=35,cinder:DELETE=17 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:49:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-1873c070-13a1-4752-98fe-36a51d4d7be1 req-2fec84b4-15df-457a-b8da-f252de32dc77 tempest-TestStampPattern-2006903719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:49:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-1873c070-13a1-4752-98fe-36a51d4d7be1 req-2fec84b4-15df-457a-b8da-f252de32dc77 tempest-TestStampPattern-2006903719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:49:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [req-1873c070-13a1-4752-98fe-36a51d4d7be1 req-2fec84b4-15df-457a-b8da-f252de32dc77 tempest-TestStampPattern-2006903719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:49:59 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-1873c070-13a1-4752-98fe-36a51d4d7be1 req-2fec84b4-15df-457a-b8da-f252de32dc77 tempest-TestStampPattern-2006903719 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476', 'name': 'volume-d6ada00b-3343-449a-904d-d7355755a9a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9af564e5-772c-462e-b10a-a064e6093875', 'enforce_multipath': True} {{(pid=86794) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:49:59 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-1873c070-13a1-4752-98fe-36a51d4d7be1 req-2fec84b4-15df-457a-b8da-f252de32dc77 tempest-TestStampPattern-2006903719 None] attachment_update completed successfully. Nov 06 18:50:03 devstack cinder-volume[86794]: INFO cinder.volume.manager [req-5545b501-e66c-49ff-90af-f028eb5937ba req-2d15412f-bebf-490d-96cc-f57bcdd89326 tempest-TestStampPattern-2006903719 None] Terminate volume connection completed successfully. Nov 06 18:50:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [req-5545b501-e66c-49ff-90af-f028eb5937ba req-2d15412f-bebf-490d-96cc-f57bcdd89326 tempest-TestStampPattern-2006903719 None] Deleting attachment 9af564e5-772c-462e-b10a-a064e6093875. {{(pid=86794) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:50:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6c1f5ba4-8720-4e1b-90cd-46bb48f14391 tempest-TestStampPattern-2006903719 None] Acquiring lock "cinder-d6ada00b-3343-449a-904d-d7355755a9a0-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6c1f5ba4-8720-4e1b-90cd-46bb48f14391 tempest-TestStampPattern-2006903719 None] Lock "cinder-d6ada00b-3343-449a-904d-d7355755a9a0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6c1f5ba4-8720-4e1b-90cd-46bb48f14391 tempest-TestStampPattern-2006903719 None] Acquiring lock "cinder-quobyte-d6ada00b-3343-449a-904d-d7355755a9a0" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6c1f5ba4-8720-4e1b-90cd-46bb48f14391 tempest-TestStampPattern-2006903719 None] Lock "cinder-quobyte-d6ada00b-3343-449a-904d-d7355755a9a0" acquired by "delete_volume" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:08 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[201bd62b-165f-40e6-b25a-f23f03f5c2a4]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:50:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6c1f5ba4-8720-4e1b-90cd-46bb48f14391 tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d6ada00b-3343-449a-904d-d7355755a9a0 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:08 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d6ada00b-3343-449a-904d-d7355755a9a0 Nov 06 18:50:08 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:08 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6c1f5ba4-8720-4e1b-90cd-46bb48f14391 tempest-TestStampPattern-2006903719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d6ada00b-3343-449a-904d-d7355755a9a0" returned: 0 in 0.430s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6c1f5ba4-8720-4e1b-90cd-46bb48f14391 tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d6ada00b-3343-449a-904d-d7355755a9a0 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:08 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d6ada00b-3343-449a-904d-d7355755a9a0 Nov 06 18:50:08 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:09 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6c1f5ba4-8720-4e1b-90cd-46bb48f14391 tempest-TestStampPattern-2006903719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d6ada00b-3343-449a-904d-d7355755a9a0" returned: 0 in 0.251s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6c1f5ba4-8720-4e1b-90cd-46bb48f14391 tempest-TestStampPattern-2006903719 None] Lock "cinder-quobyte-d6ada00b-3343-449a-904d-d7355755a9a0" released by "delete_volume" :: held 0.731s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-6c1f5ba4-8720-4e1b-90cd-46bb48f14391 tempest-TestStampPattern-2006903719 None] Created reservations ['0a3ee876-82cf-431a-a48c-aa5a2abbe568', '2ee17332-072a-4b98-984d-419fdeae07bf', '985bef27-4c4f-4695-b67d-b69c11ee66bf', 'fc3e9058-6db4-49ff-9b02-162b8a68b1a9'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6c1f5ba4-8720-4e1b-90cd-46bb48f14391 tempest-TestStampPattern-2006903719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6c1f5ba4-8720-4e1b-90cd-46bb48f14391 tempest-TestStampPattern-2006903719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6c1f5ba4-8720-4e1b-90cd-46bb48f14391 tempest-TestStampPattern-2006903719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6c1f5ba4-8720-4e1b-90cd-46bb48f14391 tempest-TestStampPattern-2006903719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6c1f5ba4-8720-4e1b-90cd-46bb48f14391 tempest-TestStampPattern-2006903719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6c1f5ba4-8720-4e1b-90cd-46bb48f14391 tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:09 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:50:09 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:09 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6c1f5ba4-8720-4e1b-90cd-46bb48f14391 tempest-TestStampPattern-2006903719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.250s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-6c1f5ba4-8720-4e1b-90cd-46bb48f14391 tempest-TestStampPattern-2006903719 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:50:09 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-6c1f5ba4-8720-4e1b-90cd-46bb48f14391 tempest-TestStampPattern-2006903719 None] Deleted volume successfully. Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6c1f5ba4-8720-4e1b-90cd-46bb48f14391 tempest-TestStampPattern-2006903719 None] Lock "cinder-d6ada00b-3343-449a-904d-d7355755a9a0-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] Acquiring lock "cinder-ffc46989-24fb-4c40-99fe-370f8dc54f47-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] Lock "cinder-ffc46989-24fb-4c40-99fe-370f8dc54f47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] Acquiring lock "cinder-quobyte-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] Lock "cinder-quobyte-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] Acquiring lock "cinder-quobyte-ffc46989-24fb-4c40-99fe-370f8dc54f47" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] Lock "cinder-quobyte-ffc46989-24fb-4c40-99fe-370f8dc54f47" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] Deleting offline snapshot ffc46989-24fb-4c40-99fe-370f8dc54f47 of volume 03ffe90b-88ba-4cd2-94c2-cb341ca63e0a {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] snapshot_file for this snap is: volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[4899397b-e982-4200-b470-98f6bf924d45]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:50:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:09 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47 Nov 06 18:50:09 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:10 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47" returned: 0 in 0.383s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:50:10 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b22383b-25db-4a76-bd8d-b5394e2340c5]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:50:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:10 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a Nov 06 18:50:10 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:10 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a" returned: 0 in 0.534s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:10 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47 Nov 06 18:50:10 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:11 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47" returned: 0 in 0.340s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:11 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47 Nov 06 18:50:11 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:11 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a.ffc46989-24fb-4c40-99fe-370f8dc54f47" returned: 0 in 0.253s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:11 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] Lock "cinder-quobyte-ffc46989-24fb-4c40-99fe-370f8dc54f47" released by "_delete_snapshot" :: held 1.614s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:11 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] Lock "cinder-quobyte-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a" released by "delete_snapshot" :: held 1.641s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:11 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] Created reservations ['61aca773-f9e5-410c-b06a-38a427b7b9c2', '2a650ac5-0421-4edc-aa77-d7b742593802', 'a07227e3-579e-4d60-923f-4ad3b16fef69', '6b338dcf-b1d6-41cf-8250-23f59584f437'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:50:11 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] Delete snapshot completed successfully. Nov 06 18:50:11 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-b6f895e4-7427-4cd0-a261-93adef18a70b tempest-TestStampPattern-2006903719 None] Lock "cinder-ffc46989-24fb-4c40-99fe-370f8dc54f47-delete_snapshot" released by "delete_snapshot" :: held 1.867s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ee85c1e7-0a39-4b7f-8291-474058dccdde tempest-TestStampPattern-2006903719 None] Acquiring lock "cinder-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ee85c1e7-0a39-4b7f-8291-474058dccdde tempest-TestStampPattern-2006903719 None] Lock "cinder-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ee85c1e7-0a39-4b7f-8291-474058dccdde tempest-TestStampPattern-2006903719 None] Acquiring lock "cinder-quobyte-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ee85c1e7-0a39-4b7f-8291-474058dccdde tempest-TestStampPattern-2006903719 None] Lock "cinder-quobyte-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a" acquired by "delete_volume" :: waited 0.016s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:15 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[c041d978-de5f-4707-a564-118fce034543]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:50:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ee85c1e7-0a39-4b7f-8291-474058dccdde tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:15 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a Nov 06 18:50:15 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:16 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ee85c1e7-0a39-4b7f-8291-474058dccdde tempest-TestStampPattern-2006903719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a" returned: 0 in 0.376s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ee85c1e7-0a39-4b7f-8291-474058dccdde tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:16 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a Nov 06 18:50:16 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:16 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ee85c1e7-0a39-4b7f-8291-474058dccdde tempest-TestStampPattern-2006903719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a" returned: 0 in 0.245s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ee85c1e7-0a39-4b7f-8291-474058dccdde tempest-TestStampPattern-2006903719 None] Lock "cinder-quobyte-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a" released by "delete_volume" :: held 0.711s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:16 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-ee85c1e7-0a39-4b7f-8291-474058dccdde tempest-TestStampPattern-2006903719 None] Created reservations ['e0d79fe1-ae5d-43dc-bb8c-fcbe6b4db9e8', '6c267e25-6fc2-4c67-9632-4ec6d1dfe55e', '6b40ff06-00c8-4f32-a6f7-cd7d37e1d387', '94237878-3546-4873-8e1c-4b12a5559718'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:50:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ee85c1e7-0a39-4b7f-8291-474058dccdde tempest-TestStampPattern-2006903719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:50:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ee85c1e7-0a39-4b7f-8291-474058dccdde tempest-TestStampPattern-2006903719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:50:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ee85c1e7-0a39-4b7f-8291-474058dccdde tempest-TestStampPattern-2006903719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:50:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ee85c1e7-0a39-4b7f-8291-474058dccdde tempest-TestStampPattern-2006903719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:50:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ee85c1e7-0a39-4b7f-8291-474058dccdde tempest-TestStampPattern-2006903719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:50:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ee85c1e7-0a39-4b7f-8291-474058dccdde tempest-TestStampPattern-2006903719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:16 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:50:16 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:16 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ee85c1e7-0a39-4b7f-8291-474058dccdde tempest-TestStampPattern-2006903719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.287s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:16 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-ee85c1e7-0a39-4b7f-8291-474058dccdde tempest-TestStampPattern-2006903719 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:50:16 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-ee85c1e7-0a39-4b7f-8291-474058dccdde tempest-TestStampPattern-2006903719 None] Deleted volume successfully. Nov 06 18:50:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ee85c1e7-0a39-4b7f-8291-474058dccdde tempest-TestStampPattern-2006903719 None] Lock "cinder-03ffe90b-88ba-4cd2-94c2-cb341ca63e0a-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Flow 'volume_create_manager' (6980071a-90a3-4a7c-9bb6-1683e8a6c368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06cdaaaf-4618-46cb-9ad0-aef59c8f6552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06cdaaaf-4618-46cb-9ad0-aef59c8f6552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1599457898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1193c17e-e09a-4d3f-8765-281a0956d691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f928542a7994d668fdb88a823f1a449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:50:20Z,use_quota=True,user_id='2f685ef42e5f404ca4fc92b037d3f393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bb92d3-c901-4c81-a278-1251db0e6b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bb92d3-c901-4c81-a278-1251db0e6b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be75f8ef-9578-40c0-82d5-07b9df583411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be75f8ef-9578-40c0-82d5-07b9df583411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1193c17e-e09a-4d3f-8765-281a0956d691', 'volume_name': 'volume-1193c17e-e09a-4d3f-8765-281a0956d691', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cbd7053-2ceb-43c0-970f-24383c591f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cbd7053-2ceb-43c0-970f-24383c591f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b52fb07-8019-4e17-aa2e-d93ee9a81b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:19 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Volume 1193c17e-e09a-4d3f-8765-281a0956d691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1193c17e-e09a-4d3f-8765-281a0956d691', 'volume_size': 1} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1599457898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1193c17e-e09a-4d3f-8765-281a0956d691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f928542a7994d668fdb88a823f1a449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:50:20Z,use_quota=True,user_id='2f685ef42e5f404ca4fc92b037d3f393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Creating volume 1193c17e-e09a-4d3f-8765-281a0956d691 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:50:19 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:50:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:19 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691 1073741824 Nov 06 18:50:19 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:20 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691 1073741824" returned: 0 in 0.503s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:20 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691 Nov 06 18:50:20 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:20 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691" returned: 0 in 0.257s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:50:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:50:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b52fb07-8019-4e17-aa2e-d93ee9a81b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1193c17e-e09a-4d3f-8765-281a0956d691', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bfb4fdc-78c5-489a-9162-92ae86b8319e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:20 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Volume volume-1193c17e-e09a-4d3f-8765-281a0956d691 (1193c17e-e09a-4d3f-8765-281a0956d691): created successfully Nov 06 18:50:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bfb4fdc-78c5-489a-9162-92ae86b8319e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Flow 'volume_create_manager' (6980071a-90a3-4a7c-9bb6-1683e8a6c368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:50:20 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-cfdac7b5-0179-4445-a354-01aec90a4f9c tempest-SnapshotDependencyTests-1712184173 None] Created volume successfully. Nov 06 18:50:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-85f95e0c-2de6-45d1-a8b9-0822feb836b5 tempest-SnapshotDependencyTests-1712184173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:50:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-85f95e0c-2de6-45d1-a8b9-0822feb836b5 tempest-SnapshotDependencyTests-1712184173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:50:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-85f95e0c-2de6-45d1-a8b9-0822feb836b5 tempest-SnapshotDependencyTests-1712184173 None] Creating offline snapshot 9ef7da9b-d375-49c7-a4b3-1fce46639aec of volume 1193c17e-e09a-4d3f-8765-281a0956d691 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:50:21 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e43c74-6ddf-4898-866f-1a91bc20202f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:50:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85f95e0c-2de6-45d1-a8b9-0822feb836b5 tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:22 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691 Nov 06 18:50:22 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:22 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85f95e0c-2de6-45d1-a8b9-0822feb836b5 tempest-SnapshotDependencyTests-1712184173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691" returned: 0 in 0.376s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85f95e0c-2de6-45d1-a8b9-0822feb836b5 tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:22 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec 1G Nov 06 18:50:22 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:22 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85f95e0c-2de6-45d1-a8b9-0822feb836b5 tempest-SnapshotDependencyTests-1712184173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec 1G" returned: 0 in 0.453s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85f95e0c-2de6-45d1-a8b9-0822feb836b5 tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1193c17e-e09a-4d3f-8765-281a0956d691 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:22 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1193c17e-e09a-4d3f-8765-281a0956d691 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec Nov 06 18:50:22 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:23 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85f95e0c-2de6-45d1-a8b9-0822feb836b5 tempest-SnapshotDependencyTests-1712184173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1193c17e-e09a-4d3f-8765-281a0956d691 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec" returned: 0 in 0.306s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:23 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-85f95e0c-2de6-45d1-a8b9-0822feb836b5 tempest-SnapshotDependencyTests-1712184173 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec is being set with open permissions: ugo+rw Nov 06 18:50:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85f95e0c-2de6-45d1-a8b9-0822feb836b5 tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:23 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec Nov 06 18:50:23 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:23 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85f95e0c-2de6-45d1-a8b9-0822feb836b5 tempest-SnapshotDependencyTests-1712184173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec" returned: 0 in 0.253s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85f95e0c-2de6-45d1-a8b9-0822feb836b5 tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:23 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.info Nov 06 18:50:23 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:23 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85f95e0c-2de6-45d1-a8b9-0822feb836b5 tempest-SnapshotDependencyTests-1712184173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.info" returned: 0 in 0.254s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:23 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-85f95e0c-2de6-45d1-a8b9-0822feb836b5 tempest-SnapshotDependencyTests-1712184173 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.info is being set with open permissions: ugo+rw Nov 06 18:50:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85f95e0c-2de6-45d1-a8b9-0822feb836b5 tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:23 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.info Nov 06 18:50:23 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:23 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85f95e0c-2de6-45d1-a8b9-0822feb836b5 tempest-SnapshotDependencyTests-1712184173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.info" returned: 0 in 0.253s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-85f95e0c-2de6-45d1-a8b9-0822feb836b5 tempest-SnapshotDependencyTests-1712184173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:50:23 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-85f95e0c-2de6-45d1-a8b9-0822feb836b5 tempest-SnapshotDependencyTests-1712184173 None] Create snapshot completed successfully Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Flow 'volume_create_manager' (cacc205f-7bdb-4d1f-bdee-c4a5022683b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5f1649-14b5-46af-bf82-9a5190abd344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5f1649-14b5-46af-bf82-9a5190abd344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4072cc06-eb0f-4903-9d34-e0ca9fafd18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f928542a7994d668fdb88a823f1a449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9ef7da9b-d375-49c7-a4b3-1fce46639aec,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:50:26Z,use_quota=True,user_id='2f685ef42e5f404ca4fc92b037d3f393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9110daec-fe77-4da2-9e0f-252dda896f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9110daec-fe77-4da2-9e0f-252dda896f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649b87c6-60d9-477f-8758-476e451f8280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649b87c6-60d9-477f-8758-476e451f8280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4072cc06-eb0f-4903-9d34-e0ca9fafd18a', 'volume_name': 'volume-4072cc06-eb0f-4903-9d34-e0ca9fafd18a', 'volume_size': 1, 'snapshot_id': '9ef7da9b-d375-49c7-a4b3-1fce46639aec'}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e0dbd6-876e-4bb6-b241-d0c8e7536a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e0dbd6-876e-4bb6-b241-d0c8e7536a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (474a688c-1c7f-4059-ac09-55de908ccb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:25 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Volume 4072cc06-eb0f-4903-9d34-e0ca9fafd18a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4072cc06-eb0f-4903-9d34-e0ca9fafd18a', 'volume_size': 1, 'snapshot_id': '9ef7da9b-d375-49c7-a4b3-1fce46639aec'} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Acquiring lock "cinder-quobyte-9ef7da9b-d375-49c7-a4b3-1fce46639aec-4072cc06-eb0f-4903-9d34-e0ca9fafd18a" by "_create_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Lock "cinder-quobyte-9ef7da9b-d375-49c7-a4b3-1fce46639aec-4072cc06-eb0f-4903-9d34-e0ca9fafd18a" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Creating volume 4072cc06-eb0f-4903-9d34-e0ca9fafd18a from snapshot 9ef7da9b-d375-49c7-a4b3-1fce46639aec {{(pid=86794) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Acquiring lock "cinder-quobyte-4072cc06-eb0f-4903-9d34-e0ca9fafd18a" by "_copy_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Lock "cinder-quobyte-4072cc06-eb0f-4903-9d34-e0ca9fafd18a" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] snapshot: 9ef7da9b-d375-49c7-a4b3-1fce46639aec, volume: 4072cc06-eb0f-4903-9d34-e0ca9fafd18a, {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[39584113-5de3-4f50-8298-0f01bc9f4c4d]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:50:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:26 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec Nov 06 18:50:26 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:26 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec" returned: 0 in 0.430s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:26 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1193c17e-e09a-4d3f-8765-281a0956d691(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:50:26 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[857d29b1-275e-4518-aa60-68f632a1ab26]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:50:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:26 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691 Nov 06 18:50:26 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:26 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691" returned: 0 in 0.398s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:26 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691 {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 18:50:26 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Creating direct copy from snapshot {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 18:50:26 devstack cinder-volume[86794]: DEBUG cinder.utils [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Path /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4072cc06-eb0f-4903-9d34-e0ca9fafd18a not found in is_blk_device check {{(pid=86794) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 18:50:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4072cc06-eb0f-4903-9d34-e0ca9fafd18a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:26 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4072cc06-eb0f-4903-9d34-e0ca9fafd18a Nov 06 18:50:26 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:50:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:50:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:50:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:50:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:50:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:50:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:29 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:50:29 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:29 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.372s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:50:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:50:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 29 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:50:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:50:33 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4072cc06-eb0f-4903-9d34-e0ca9fafd18a" returned: 0 in 7.008s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:33 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691, size 1024.00 MB, duration 7.01 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4072cc06-eb0f-4903-9d34-e0ca9fafd18a {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:50:33 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Converted 1024.00 MB image at 146.10 MB/s Nov 06 18:50:33 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4072cc06-eb0f-4903-9d34-e0ca9fafd18a is being set with open permissions: ugo+rw Nov 06 18:50:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4072cc06-eb0f-4903-9d34-e0ca9fafd18a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:33 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4072cc06-eb0f-4903-9d34-e0ca9fafd18a Nov 06 18:50:33 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:34 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4072cc06-eb0f-4903-9d34-e0ca9fafd18a" returned: 0 in 0.238s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Lock "cinder-quobyte-4072cc06-eb0f-4903-9d34-e0ca9fafd18a" released by "_copy_volume_from_snapshot" :: held 8.158s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Lock "cinder-quobyte-9ef7da9b-d375-49c7-a4b3-1fce46639aec-4072cc06-eb0f-4903-9d34-e0ca9fafd18a" released by "_create_volume_from_snapshot" :: held 8.224s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.239s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (474a688c-1c7f-4059-ac09-55de908ccb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4072cc06-eb0f-4903-9d34-e0ca9fafd18a', 'volume_size': 1, 'snapshot_id': '9ef7da9b-d375-49c7-a4b3-1fce46639aec'}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b09747-9235-40c1-9871-cde372f3cf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:34 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Volume volume-4072cc06-eb0f-4903-9d34-e0ca9fafd18a (4072cc06-eb0f-4903-9d34-e0ca9fafd18a): created successfully Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b09747-9235-40c1-9871-cde372f3cf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Flow 'volume_create_manager' (cacc205f-7bdb-4d1f-bdee-c4a5022683b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:50:34 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-ef0a6b22-2558-48c8-bbc6-3277990f0c1b tempest-SnapshotDependencyTests-1712184173 None] Created volume successfully. Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Flow 'volume_create_manager' (39721aa3-e8f5-4663-b9a9-ad3bac6aec1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd1793b0-1817-4321-b61a-49ab6c19c03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd1793b0-1817-4321-b61a-49ab6c19c03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99441681-1ef7-4dfd-b08d-ef8f217bf3ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e63630eee849ecbe9c355ef4786fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:50:34Z,use_quota=True,user_id='ad3986616ab34ff5a59e5329903e8d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d99c9a3-1acb-4711-af99-e0169c4cc6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d99c9a3-1acb-4711-af99-e0169c4cc6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fa6d5c-8017-4e45-ba7f-07757ad356cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.image.glance [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Creating Keystone auth plugin from conf {{(pid=86794) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] Acquiring lock "cinder-9ef7da9b-d375-49c7-a4b3-1fce46639aec-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] Lock "cinder-9ef7da9b-d375-49c7-a4b3-1fce46639aec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] Acquiring lock "cinder-quobyte-1193c17e-e09a-4d3f-8765-281a0956d691" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] Lock "cinder-quobyte-1193c17e-e09a-4d3f-8765-281a0956d691" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] Acquiring lock "cinder-quobyte-9ef7da9b-d375-49c7-a4b3-1fce46639aec" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] Lock "cinder-quobyte-9ef7da9b-d375-49c7-a4b3-1fce46639aec" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] Deleting offline snapshot 9ef7da9b-d375-49c7-a4b3-1fce46639aec of volume 1193c17e-e09a-4d3f-8765-281a0956d691 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] snapshot_file for this snap is: volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[654f8660-13ce-4895-bcc6-506964c96c25]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fa6d5c-8017-4e45-ba7f-07757ad356cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '99441681-1ef7-4dfd-b08d-ef8f217bf3ba', 'volume_name': 'volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba', 'volume_size': 1, 'image_id': '52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '77794713e526c079ef9a89701635d85d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '86e63630eee849ecbe9c355ef4786fb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c6fd9e6b4ce4efaa88dd8b25509ab7cf09bb8d4e529b1a20fc92a18e5421a7bfe43ad1b0c1bf8721cb5996caf4a065a76ca82f06f02d2adeeae7cdd95cf42b6b', 'id': '52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a', 'created_at': datetime.datetime(2026, 11, 6, 17, 50, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 50, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a/file', 'properties': {}}, 'image_service': }' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7a75f3-05c2-4a18-b528-f9d9c24bf152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7a75f3-05c2-4a18-b528-f9d9c24bf152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348c11db-ba08-411f-ab0b-9f7dfc94a1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:34 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Volume 99441681-1ef7-4dfd-b08d-ef8f217bf3ba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba', 'volume_size': 1, 'image_id': '52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '77794713e526c079ef9a89701635d85d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '86e63630eee849ecbe9c355ef4786fb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c6fd9e6b4ce4efaa88dd8b25509ab7cf09bb8d4e529b1a20fc92a18e5421a7bfe43ad1b0c1bf8721cb5996caf4a065a76ca82f06f02d2adeeae7cdd95cf42b6b', 'id': '52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a', 'created_at': datetime.datetime(2026, 11, 6, 17, 50, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 50, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a/file', 'properties': {}}, 'image_service': } Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Trying to clone 99441681-1ef7-4dfd-b08d-ef8f217bf3ba from image 52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a at location (None, [{'url': 'file:///opt/stack/data/glance/images/52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a', 'metadata': {}}]). {{(pid=86794) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 18:50:34 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec Nov 06 18:50:34 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 18:50:34 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Image download 0.00 MB at 0.00 MB/s Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef429fc-c0cb-48de-ba33-f106228fb0c8]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:34 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD Nov 06 18:50:34 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:34 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec" returned: 0 in 0.374s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1193c17e-e09a-4d3f-8765-281a0956d691(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:50:35 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[910aa7e4-9623-48bb-891a-0959e1b6baf8]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:50:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:35 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691 Nov 06 18:50:35 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:35 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:35 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD Nov 06 18:50:35 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:35 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD" returned: 1 in 0.310s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:50:35 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Temporary image 52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a is fetched for user ad3986616ab34ff5a59e5329903e8d9d. {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 18:50:35 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691" returned: 0 in 0.565s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:35 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec Nov 06 18:50:35 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:35 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a85213-698e-4c7d-8da0-cebea4f0776b]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:50:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:35 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD Nov 06 18:50:35 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:35 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec" returned: 0 in 0.343s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:35 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec Nov 06 18:50:35 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:36 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:36 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD Nov 06 18:50:36 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:36 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691.9ef7da9b-d375-49c7-a4b3-1fce46639aec" returned: 0 in 0.240s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] Lock "cinder-quobyte-9ef7da9b-d375-49c7-a4b3-1fce46639aec" released by "_delete_snapshot" :: held 1.631s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] Lock "cinder-quobyte-1193c17e-e09a-4d3f-8765-281a0956d691" released by "delete_snapshot" :: held 1.659s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] Created reservations ['42df50c9-f2a7-4674-b4ec-8ae4e277c098', 'd0cd8c85-e6ad-41e2-8f17-db1e15b8110c', '94624e4d-346f-4614-9857-ed268617aaaf', 'b096a191-3fa2-4a20-86e5-14d0568c0988'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:50:36 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] Delete snapshot completed successfully. Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6150ee2f-bf08-463e-a703-7ca8da64c3c6 tempest-SnapshotDependencyTests-1712184173 None] Lock "cinder-9ef7da9b-d375-49c7-a4b3-1fce46639aec-delete_snapshot" released by "delete_snapshot" :: held 1.805s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:36 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99441681-1ef7-4dfd-b08d-ef8f217bf3ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e63630eee849ecbe9c355ef4786fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:50:34Z,use_quota=True,user_id='ad3986616ab34ff5a59e5329903e8d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Creating volume 99441681-1ef7-4dfd-b08d-ef8f217bf3ba {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:50:36 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:36 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba 1073741824 Nov 06 18:50:36 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d22ded50-0b2c-4ae8-8a66-6b61fdfbe1d9 tempest-SnapshotDependencyTests-1712184173 None] Acquiring lock "cinder-1193c17e-e09a-4d3f-8765-281a0956d691-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d22ded50-0b2c-4ae8-8a66-6b61fdfbe1d9 tempest-SnapshotDependencyTests-1712184173 None] Lock "cinder-1193c17e-e09a-4d3f-8765-281a0956d691-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d22ded50-0b2c-4ae8-8a66-6b61fdfbe1d9 tempest-SnapshotDependencyTests-1712184173 None] Acquiring lock "cinder-quobyte-1193c17e-e09a-4d3f-8765-281a0956d691" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d22ded50-0b2c-4ae8-8a66-6b61fdfbe1d9 tempest-SnapshotDependencyTests-1712184173 None] Lock "cinder-quobyte-1193c17e-e09a-4d3f-8765-281a0956d691" acquired by "delete_volume" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7c7976-1a7c-4621-a333-7af3c9c97d83]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d22ded50-0b2c-4ae8-8a66-6b61fdfbe1d9 tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:36 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba 1073741824" returned: 0 in 0.466s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:36 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba Nov 06 18:50:36 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:36 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691 Nov 06 18:50:36 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:37 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba" returned: 0 in 0.263s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Attempting download of 52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a ((None, [{'url': 'file:///opt/stack/data/glance/images/52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a', 'metadata': {}}])) to volume 99441681-1ef7-4dfd-b08d-ef8f217bf3ba. {{(pid=86794) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 18:50:37 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d22ded50-0b2c-4ae8-8a66-6b61fdfbe1d9 tempest-SnapshotDependencyTests-1712184173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691" returned: 0 in 0.378s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d22ded50-0b2c-4ae8-8a66-6b61fdfbe1d9 tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:37 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691 Nov 06 18:50:37 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa363a9e-0a17-4eca-8d21-c5b41131b2b5]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_wcfdndnu {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:37 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_wcfdndnu Nov 06 18:50:37 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:37 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d22ded50-0b2c-4ae8-8a66-6b61fdfbe1d9 tempest-SnapshotDependencyTests-1712184173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1193c17e-e09a-4d3f-8765-281a0956d691" returned: 0 in 0.257s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d22ded50-0b2c-4ae8-8a66-6b61fdfbe1d9 tempest-SnapshotDependencyTests-1712184173 None] Lock "cinder-quobyte-1193c17e-e09a-4d3f-8765-281a0956d691" released by "delete_volume" :: held 0.716s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-d22ded50-0b2c-4ae8-8a66-6b61fdfbe1d9 tempest-SnapshotDependencyTests-1712184173 None] Created reservations ['0c46e4f8-2b6c-42b0-bc2b-c202d2fc6dc2', 'd7ef571d-155d-474c-abfc-772093df1998', 'b18ff958-5444-4e78-8197-676152f68580', 'eaa71c4f-2289-402c-a877-3f52d172cb9c'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:50:37 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_wcfdndnu" returned: 0 in 0.348s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_wcfdndnu {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d22ded50-0b2c-4ae8-8a66-6b61fdfbe1d9 tempest-SnapshotDependencyTests-1712184173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d22ded50-0b2c-4ae8-8a66-6b61fdfbe1d9 tempest-SnapshotDependencyTests-1712184173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d22ded50-0b2c-4ae8-8a66-6b61fdfbe1d9 tempest-SnapshotDependencyTests-1712184173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d22ded50-0b2c-4ae8-8a66-6b61fdfbe1d9 tempest-SnapshotDependencyTests-1712184173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d22ded50-0b2c-4ae8-8a66-6b61fdfbe1d9 tempest-SnapshotDependencyTests-1712184173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d22ded50-0b2c-4ae8-8a66-6b61fdfbe1d9 tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:37 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_wcfdndnu Nov 06 18:50:37 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:37 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:50:37 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-75d4093c-41cf-4127-84dc-56a622e4d944 tempest-SnapshotDependencyTests-1712184173 None] Acquiring lock "cinder-4072cc06-eb0f-4903-9d34-e0ca9fafd18a-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-75d4093c-41cf-4127-84dc-56a622e4d944 tempest-SnapshotDependencyTests-1712184173 None] Lock "cinder-4072cc06-eb0f-4903-9d34-e0ca9fafd18a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:37 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:37 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d22ded50-0b2c-4ae8-8a66-6b61fdfbe1d9 tempest-SnapshotDependencyTests-1712184173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.277s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-d22ded50-0b2c-4ae8-8a66-6b61fdfbe1d9 tempest-SnapshotDependencyTests-1712184173 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_wcfdndnu" returned: 1 in 0.372s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_wcfdndnu' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:50:37 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-d22ded50-0b2c-4ae8-8a66-6b61fdfbe1d9 tempest-SnapshotDependencyTests-1712184173 None] Deleted volume successfully. Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccbd619-09c9-4af7-a1eb-9e8e51f7abcb]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-75d4093c-41cf-4127-84dc-56a622e4d944 tempest-SnapshotDependencyTests-1712184173 None] Acquiring lock "cinder-quobyte-4072cc06-eb0f-4903-9d34-e0ca9fafd18a" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d22ded50-0b2c-4ae8-8a66-6b61fdfbe1d9 tempest-SnapshotDependencyTests-1712184173 None] Lock "cinder-1193c17e-e09a-4d3f-8765-281a0956d691-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-75d4093c-41cf-4127-84dc-56a622e4d944 tempest-SnapshotDependencyTests-1712184173 None] Lock "cinder-quobyte-4072cc06-eb0f-4903-9d34-e0ca9fafd18a" acquired by "delete_volume" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e7a5ae-83b4-40b9-bb79-26f199c94ec8]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75d4093c-41cf-4127-84dc-56a622e4d944 tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4072cc06-eb0f-4903-9d34-e0ca9fafd18a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:38 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD Nov 06 18:50:38 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:38 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4072cc06-eb0f-4903-9d34-e0ca9fafd18a Nov 06 18:50:38 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:38 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:38 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75d4093c-41cf-4127-84dc-56a622e4d944 tempest-SnapshotDependencyTests-1712184173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4072cc06-eb0f-4903-9d34-e0ca9fafd18a" returned: 0 in 0.366s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75d4093c-41cf-4127-84dc-56a622e4d944 tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4072cc06-eb0f-4903-9d34-e0ca9fafd18a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:38 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD Nov 06 18:50:38 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:38 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4072cc06-eb0f-4903-9d34-e0ca9fafd18a Nov 06 18:50:38 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:38 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD" returned: 1 in 0.330s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] 52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a was raw, converting to qcow2 {{(pid=86794) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 18:50:38 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75d4093c-41cf-4127-84dc-56a622e4d944 tempest-SnapshotDependencyTests-1712184173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4072cc06-eb0f-4903-9d34-e0ca9fafd18a" returned: 0 in 0.257s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:38 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba Nov 06 18:50:38 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-75d4093c-41cf-4127-84dc-56a622e4d944 tempest-SnapshotDependencyTests-1712184173 None] Lock "cinder-quobyte-4072cc06-eb0f-4903-9d34-e0ca9fafd18a" released by "delete_volume" :: held 0.675s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-75d4093c-41cf-4127-84dc-56a622e4d944 tempest-SnapshotDependencyTests-1712184173 None] Created reservations ['a8fc88d3-a919-4c56-bd40-49d1c1a52d77', '98930d99-5f41-4f1b-a2fb-ea4e624ab538', 'd4b50bb3-2a3a-49b1-9068-8537beaac635', '32d61bce-87b7-482f-a2d7-e071810e7435'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-75d4093c-41cf-4127-84dc-56a622e4d944 tempest-SnapshotDependencyTests-1712184173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-75d4093c-41cf-4127-84dc-56a622e4d944 tempest-SnapshotDependencyTests-1712184173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-75d4093c-41cf-4127-84dc-56a622e4d944 tempest-SnapshotDependencyTests-1712184173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-75d4093c-41cf-4127-84dc-56a622e4d944 tempest-SnapshotDependencyTests-1712184173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-75d4093c-41cf-4127-84dc-56a622e4d944 tempest-SnapshotDependencyTests-1712184173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:50:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75d4093c-41cf-4127-84dc-56a622e4d944 tempest-SnapshotDependencyTests-1712184173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:38 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:50:38 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:39 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75d4093c-41cf-4127-84dc-56a622e4d944 tempest-SnapshotDependencyTests-1712184173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.281s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:39 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-75d4093c-41cf-4127-84dc-56a622e4d944 tempest-SnapshotDependencyTests-1712184173 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:50:39 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-75d4093c-41cf-4127-84dc-56a622e4d944 tempest-SnapshotDependencyTests-1712184173 None] Deleted volume successfully. Nov 06 18:50:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-75d4093c-41cf-4127-84dc-56a622e4d944 tempest-SnapshotDependencyTests-1712184173 None] Lock "cinder-4072cc06-eb0f-4903-9d34-e0ca9fafd18a-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:39 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba" returned: 0 in 0.513s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:39 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a_qx3vw5omdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:50:39 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 18:50:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:39 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba 1G Nov 06 18:50:39 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:39 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba 1G" returned: 0 in 0.318s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:39 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Downloaded image 52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a ((None, [{'url': 'file:///opt/stack/data/glance/images/52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a', 'metadata': {}}])) to volume 99441681-1ef7-4dfd-b08d-ef8f217bf3ba successfully. {{(pid=86794) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 18:50:39 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Temporary image 52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a for user ad3986616ab34ff5a59e5329903e8d9d is deleted. {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 18:50:39 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Marking volume 99441681-1ef7-4dfd-b08d-ef8f217bf3ba as bootable. {{(pid=86794) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 18:50:39 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Copying metadata from image 52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a to 99441681-1ef7-4dfd-b08d-ef8f217bf3ba. {{(pid=86794) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 18:50:39 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Creating volume glance metadata for volume 99441681-1ef7-4dfd-b08d-ef8f217bf3ba backed by image 52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a with: {'image_id': '52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '77794713e526c079ef9a89701635d85d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86794) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 18:50:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348c11db-ba08-411f-ab0b-9f7dfc94a1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba', 'volume_size': 1, 'image_id': '52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '77794713e526c079ef9a89701635d85d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '86e63630eee849ecbe9c355ef4786fb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c6fd9e6b4ce4efaa88dd8b25509ab7cf09bb8d4e529b1a20fc92a18e5421a7bfe43ad1b0c1bf8721cb5996caf4a065a76ca82f06f02d2adeeae7cdd95cf42b6b', 'id': '52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a', 'created_at': datetime.datetime(2026, 11, 6, 17, 50, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 50, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52a0a581-ba94-4bbe-a4cd-a1de9faa6c5a/file', 'properties': {}}, 'image_service': }' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc9d0138-c717-4d87-a3b4-6f22141a6346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:39 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Volume volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba (99441681-1ef7-4dfd-b08d-ef8f217bf3ba): created successfully Nov 06 18:50:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc9d0138-c717-4d87-a3b4-6f22141a6346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Flow 'volume_create_manager' (39721aa3-e8f5-4663-b9a9-ad3bac6aec1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:50:39 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a06e8518-101d-4b3c-a60b-52bfd1b1da5d tempest-VolumeImageDependencyTests-1382594911 None] Created volume successfully. Nov 06 18:50:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d71e712b-acfb-40da-b048-2c1d49779fd3 tempest-VolumeImageDependencyTests-1382594911 None] Acquiring lock "cinder-99441681-1ef7-4dfd-b08d-ef8f217bf3ba-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d71e712b-acfb-40da-b048-2c1d49779fd3 tempest-VolumeImageDependencyTests-1382594911 None] Lock "cinder-99441681-1ef7-4dfd-b08d-ef8f217bf3ba-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d71e712b-acfb-40da-b048-2c1d49779fd3 tempest-VolumeImageDependencyTests-1382594911 None] Acquiring lock "cinder-quobyte-99441681-1ef7-4dfd-b08d-ef8f217bf3ba" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d71e712b-acfb-40da-b048-2c1d49779fd3 tempest-VolumeImageDependencyTests-1382594911 None] Lock "cinder-quobyte-99441681-1ef7-4dfd-b08d-ef8f217bf3ba" acquired by "delete_volume" :: waited 0.016s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:40 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b499ea-f15b-43b6-a560-48bcad36ab4b]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:50:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d71e712b-acfb-40da-b048-2c1d49779fd3 tempest-VolumeImageDependencyTests-1382594911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:41 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba Nov 06 18:50:41 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:41 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d71e712b-acfb-40da-b048-2c1d49779fd3 tempest-VolumeImageDependencyTests-1382594911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba" returned: 0 in 0.368s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d71e712b-acfb-40da-b048-2c1d49779fd3 tempest-VolumeImageDependencyTests-1382594911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:41 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba Nov 06 18:50:41 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:41 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d71e712b-acfb-40da-b048-2c1d49779fd3 tempest-VolumeImageDependencyTests-1382594911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-99441681-1ef7-4dfd-b08d-ef8f217bf3ba" returned: 0 in 0.251s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d71e712b-acfb-40da-b048-2c1d49779fd3 tempest-VolumeImageDependencyTests-1382594911 None] Lock "cinder-quobyte-99441681-1ef7-4dfd-b08d-ef8f217bf3ba" released by "delete_volume" :: held 0.663s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:41 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-d71e712b-acfb-40da-b048-2c1d49779fd3 tempest-VolumeImageDependencyTests-1382594911 None] Created reservations ['15d050df-73da-42ec-85d8-55c5ba57470e', 'a7c81fcd-5d5a-42dd-835c-7170cc1ea1a4', '7cdea8f1-8d1e-4609-a09c-5c7b65babaef', 'ee71845c-519b-4f05-8ca5-75f49bf234a0'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:50:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d71e712b-acfb-40da-b048-2c1d49779fd3 tempest-VolumeImageDependencyTests-1382594911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:50:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d71e712b-acfb-40da-b048-2c1d49779fd3 tempest-VolumeImageDependencyTests-1382594911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:50:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d71e712b-acfb-40da-b048-2c1d49779fd3 tempest-VolumeImageDependencyTests-1382594911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:50:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d71e712b-acfb-40da-b048-2c1d49779fd3 tempest-VolumeImageDependencyTests-1382594911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:50:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d71e712b-acfb-40da-b048-2c1d49779fd3 tempest-VolumeImageDependencyTests-1382594911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:50:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d71e712b-acfb-40da-b048-2c1d49779fd3 tempest-VolumeImageDependencyTests-1382594911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:41 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:50:41 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:41 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d71e712b-acfb-40da-b048-2c1d49779fd3 tempest-VolumeImageDependencyTests-1382594911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.234s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:41 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-d71e712b-acfb-40da-b048-2c1d49779fd3 tempest-VolumeImageDependencyTests-1382594911 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:50:41 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-d71e712b-acfb-40da-b048-2c1d49779fd3 tempest-VolumeImageDependencyTests-1382594911 None] Deleted volume successfully. Nov 06 18:50:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d71e712b-acfb-40da-b048-2c1d49779fd3 tempest-VolumeImageDependencyTests-1382594911 None] Lock "cinder-99441681-1ef7-4dfd-b08d-ef8f217bf3ba-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:45 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:50:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Flow 'volume_create_manager' (1b52774f-95b7-4aa9-88ab-7eda4a021a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:50:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20f2a76-422a-4831-b728-9eefbd5819d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20f2a76-422a-4831-b728-9eefbd5819d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-252938304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a08d222-2e26-4045-bc31-9f3050e29632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1645f3bea04545679c30ef0889bcdd22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:50:46Z,use_quota=True,user_id='8fb83b77040b49ed9f69c32a0f5ad21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f265cba-7a76-4b81-a373-ae8152d4fc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f265cba-7a76-4b81-a373-ae8152d4fc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6d748df-a220-4f44-ae3f-25f42b3f8c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6d748df-a220-4f44-ae3f-25f42b3f8c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a08d222-2e26-4045-bc31-9f3050e29632', 'volume_name': 'volume-0a08d222-2e26-4045-bc31-9f3050e29632', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da34c13b-2a0c-479e-b4c4-bccf8644ef2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da34c13b-2a0c-479e-b4c4-bccf8644ef2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952fa19e-6ccc-4c20-8c61-200c0b573f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:46 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Volume 0a08d222-2e26-4045-bc31-9f3050e29632: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a08d222-2e26-4045-bc31-9f3050e29632', 'volume_size': 1} Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-252938304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a08d222-2e26-4045-bc31-9f3050e29632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1645f3bea04545679c30ef0889bcdd22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:50:46Z,use_quota=True,user_id='8fb83b77040b49ed9f69c32a0f5ad21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Creating volume 0a08d222-2e26-4045-bc31-9f3050e29632 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:50:46 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0a08d222-2e26-4045-bc31-9f3050e29632 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:46 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0a08d222-2e26-4045-bc31-9f3050e29632 1073741824 Nov 06 18:50:46 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:46 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0a08d222-2e26-4045-bc31-9f3050e29632 1073741824" returned: 0 in 0.398s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0a08d222-2e26-4045-bc31-9f3050e29632 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:46 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0a08d222-2e26-4045-bc31-9f3050e29632 Nov 06 18:50:46 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:46 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0a08d222-2e26-4045-bc31-9f3050e29632" returned: 0 in 0.268s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952fa19e-6ccc-4c20-8c61-200c0b573f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a08d222-2e26-4045-bc31-9f3050e29632', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b8e806-105d-4e27-8dda-e73a8cf38061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:46 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Volume volume-0a08d222-2e26-4045-bc31-9f3050e29632 (0a08d222-2e26-4045-bc31-9f3050e29632): created successfully Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b8e806-105d-4e27-8dda-e73a8cf38061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:46 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Flow 'volume_create_manager' (1b52774f-95b7-4aa9-88ab-7eda4a021a56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:50:46 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-d3c56a21-d42d-468a-b772-8bdf8d89796c tempest-ProjectReaderTests-1353424500 None] Created volume successfully. Nov 06 18:50:47 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a77b3551-9e0b-4f5c-9e0a-d8f9e07c9b26 tempest-ProjectReaderTests-1353424500 None] Acquiring lock "cinder-0a08d222-2e26-4045-bc31-9f3050e29632-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:47 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a77b3551-9e0b-4f5c-9e0a-d8f9e07c9b26 tempest-ProjectReaderTests-1353424500 None] Lock "cinder-0a08d222-2e26-4045-bc31-9f3050e29632-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:47 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a77b3551-9e0b-4f5c-9e0a-d8f9e07c9b26 tempest-ProjectReaderTests-1353424500 None] Acquiring lock "cinder-quobyte-0a08d222-2e26-4045-bc31-9f3050e29632" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:47 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a77b3551-9e0b-4f5c-9e0a-d8f9e07c9b26 tempest-ProjectReaderTests-1353424500 None] Lock "cinder-quobyte-0a08d222-2e26-4045-bc31-9f3050e29632" acquired by "delete_volume" :: waited 0.016s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:47 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2b171f-3b5a-4593-80a1-1011bac46a94]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:50:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a77b3551-9e0b-4f5c-9e0a-d8f9e07c9b26 tempest-ProjectReaderTests-1353424500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0a08d222-2e26-4045-bc31-9f3050e29632 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:47 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0a08d222-2e26-4045-bc31-9f3050e29632 Nov 06 18:50:47 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:47 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a77b3551-9e0b-4f5c-9e0a-d8f9e07c9b26 tempest-ProjectReaderTests-1353424500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0a08d222-2e26-4045-bc31-9f3050e29632" returned: 0 in 0.426s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a77b3551-9e0b-4f5c-9e0a-d8f9e07c9b26 tempest-ProjectReaderTests-1353424500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0a08d222-2e26-4045-bc31-9f3050e29632 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:47 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0a08d222-2e26-4045-bc31-9f3050e29632 Nov 06 18:50:47 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:47 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a77b3551-9e0b-4f5c-9e0a-d8f9e07c9b26 tempest-ProjectReaderTests-1353424500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0a08d222-2e26-4045-bc31-9f3050e29632" returned: 0 in 0.258s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:47 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a77b3551-9e0b-4f5c-9e0a-d8f9e07c9b26 tempest-ProjectReaderTests-1353424500 None] Lock "cinder-quobyte-0a08d222-2e26-4045-bc31-9f3050e29632" released by "delete_volume" :: held 0.735s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:47 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-a77b3551-9e0b-4f5c-9e0a-d8f9e07c9b26 tempest-ProjectReaderTests-1353424500 None] Created reservations ['fc577b90-6dcb-49b1-9ffd-fc4b69ca5582', '2db28bfb-f289-48ba-99fb-22df4465f567', '3c1c743a-68a2-45e7-b588-d40dc4cf4b49', 'b2280a4f-b51e-4509-9caa-731e3dac7a70'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a77b3551-9e0b-4f5c-9e0a-d8f9e07c9b26 tempest-ProjectReaderTests-1353424500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a77b3551-9e0b-4f5c-9e0a-d8f9e07c9b26 tempest-ProjectReaderTests-1353424500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a77b3551-9e0b-4f5c-9e0a-d8f9e07c9b26 tempest-ProjectReaderTests-1353424500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a77b3551-9e0b-4f5c-9e0a-d8f9e07c9b26 tempest-ProjectReaderTests-1353424500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a77b3551-9e0b-4f5c-9e0a-d8f9e07c9b26 tempest-ProjectReaderTests-1353424500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a77b3551-9e0b-4f5c-9e0a-d8f9e07c9b26 tempest-ProjectReaderTests-1353424500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:48 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:50:48 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:48 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a77b3551-9e0b-4f5c-9e0a-d8f9e07c9b26 tempest-ProjectReaderTests-1353424500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.261s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-a77b3551-9e0b-4f5c-9e0a-d8f9e07c9b26 tempest-ProjectReaderTests-1353424500 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:50:48 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a77b3551-9e0b-4f5c-9e0a-d8f9e07c9b26 tempest-ProjectReaderTests-1353424500 None] Deleted volume successfully. Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a77b3551-9e0b-4f5c-9e0a-d8f9e07c9b26 tempest-ProjectReaderTests-1353424500 None] Lock "cinder-0a08d222-2e26-4045-bc31-9f3050e29632-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Flow 'volume_create_manager' (093d7653-8d62-4fab-bd9e-710135da4375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e8c0b4-dcd3-47c2-9250-5029b9005c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e8c0b4-dcd3-47c2-9250-5029b9005c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1367552354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0e200b-283f-4436-9fcb-1cbb715a5d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1645f3bea04545679c30ef0889bcdd22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:50:49Z,use_quota=True,user_id='8fb83b77040b49ed9f69c32a0f5ad21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9639e8cf-072c-4735-be82-653b4aeb708d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9639e8cf-072c-4735-be82-653b4aeb708d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc00c3b-21cf-4c66-a1c1-b19798c85e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc00c3b-21cf-4c66-a1c1-b19798c85e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc0e200b-283f-4436-9fcb-1cbb715a5d73', 'volume_name': 'volume-dc0e200b-283f-4436-9fcb-1cbb715a5d73', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c8da07-1817-49e6-bd09-77730595b611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c8da07-1817-49e6-bd09-77730595b611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3c5930-fe1e-4c76-961f-936a7bafd405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:48 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Volume dc0e200b-283f-4436-9fcb-1cbb715a5d73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc0e200b-283f-4436-9fcb-1cbb715a5d73', 'volume_size': 1} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1367552354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0e200b-283f-4436-9fcb-1cbb715a5d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1645f3bea04545679c30ef0889bcdd22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:50:49Z,use_quota=True,user_id='8fb83b77040b49ed9f69c32a0f5ad21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Creating volume dc0e200b-283f-4436-9fcb-1cbb715a5d73 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:50:48 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:50:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc0e200b-283f-4436-9fcb-1cbb715a5d73 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:48 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc0e200b-283f-4436-9fcb-1cbb715a5d73 1073741824 Nov 06 18:50:48 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:49 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc0e200b-283f-4436-9fcb-1cbb715a5d73 1073741824" returned: 0 in 0.463s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc0e200b-283f-4436-9fcb-1cbb715a5d73 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:49 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc0e200b-283f-4436-9fcb-1cbb715a5d73 Nov 06 18:50:49 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:49 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc0e200b-283f-4436-9fcb-1cbb715a5d73" returned: 0 in 0.255s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:49 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:50:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:50:49 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3c5930-fe1e-4c76-961f-936a7bafd405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc0e200b-283f-4436-9fcb-1cbb715a5d73', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:49 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41a12b3-4750-4287-810c-1d2dcc1cf200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:50:49 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Volume volume-dc0e200b-283f-4436-9fcb-1cbb715a5d73 (dc0e200b-283f-4436-9fcb-1cbb715a5d73): created successfully Nov 06 18:50:49 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41a12b3-4750-4287-810c-1d2dcc1cf200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:50:49 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Flow 'volume_create_manager' (093d7653-8d62-4fab-bd9e-710135da4375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:50:49 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-f2242b9f-a30c-4a64-abfe-4e140388b2a3 tempest-ProjectReaderTests-1353424500 None] Created volume successfully. Nov 06 18:50:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8952b91f-fa9c-4130-8a00-75bee2323c14 tempest-ProjectReaderTests-1353424500 None] Acquiring lock "cinder-dc0e200b-283f-4436-9fcb-1cbb715a5d73-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8952b91f-fa9c-4130-8a00-75bee2323c14 tempest-ProjectReaderTests-1353424500 None] Lock "cinder-dc0e200b-283f-4436-9fcb-1cbb715a5d73-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8952b91f-fa9c-4130-8a00-75bee2323c14 tempest-ProjectReaderTests-1353424500 None] Acquiring lock "cinder-quobyte-dc0e200b-283f-4436-9fcb-1cbb715a5d73" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:50:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8952b91f-fa9c-4130-8a00-75bee2323c14 tempest-ProjectReaderTests-1353424500 None] Lock "cinder-quobyte-dc0e200b-283f-4436-9fcb-1cbb715a5d73" acquired by "delete_volume" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:50:50 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fe04ff-7a10-4951-8df9-55c234077d84]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:50:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8952b91f-fa9c-4130-8a00-75bee2323c14 tempest-ProjectReaderTests-1353424500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc0e200b-283f-4436-9fcb-1cbb715a5d73 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:51 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc0e200b-283f-4436-9fcb-1cbb715a5d73 Nov 06 18:50:51 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:51 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8952b91f-fa9c-4130-8a00-75bee2323c14 tempest-ProjectReaderTests-1353424500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc0e200b-283f-4436-9fcb-1cbb715a5d73" returned: 0 in 0.343s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8952b91f-fa9c-4130-8a00-75bee2323c14 tempest-ProjectReaderTests-1353424500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc0e200b-283f-4436-9fcb-1cbb715a5d73 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:51 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc0e200b-283f-4436-9fcb-1cbb715a5d73 Nov 06 18:50:51 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:51 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8952b91f-fa9c-4130-8a00-75bee2323c14 tempest-ProjectReaderTests-1353424500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dc0e200b-283f-4436-9fcb-1cbb715a5d73" returned: 0 in 0.241s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:51 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8952b91f-fa9c-4130-8a00-75bee2323c14 tempest-ProjectReaderTests-1353424500 None] Lock "cinder-quobyte-dc0e200b-283f-4436-9fcb-1cbb715a5d73" released by "delete_volume" :: held 0.624s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:50:51 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-8952b91f-fa9c-4130-8a00-75bee2323c14 tempest-ProjectReaderTests-1353424500 None] Created reservations ['480c02ec-7daf-4d25-b4c0-9ddad8fd0a7a', '6f090c81-e407-455b-8af6-cd3e682ebb44', '654cfa57-ba19-48ee-89c8-4983163aa7b1', '1b8df96f-0e29-4f72-86b8-2132bb7be63c'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:50:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8952b91f-fa9c-4130-8a00-75bee2323c14 tempest-ProjectReaderTests-1353424500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:50:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8952b91f-fa9c-4130-8a00-75bee2323c14 tempest-ProjectReaderTests-1353424500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:50:51 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8952b91f-fa9c-4130-8a00-75bee2323c14 tempest-ProjectReaderTests-1353424500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:50:51 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8952b91f-fa9c-4130-8a00-75bee2323c14 tempest-ProjectReaderTests-1353424500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:50:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8952b91f-fa9c-4130-8a00-75bee2323c14 tempest-ProjectReaderTests-1353424500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:50:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8952b91f-fa9c-4130-8a00-75bee2323c14 tempest-ProjectReaderTests-1353424500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:50:51 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:50:51 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:50:51 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Nov 06 18:50:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8952b91f-fa9c-4130-8a00-75bee2323c14 tempest-ProjectReaderTests-1353424500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.241s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:50:51 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-8952b91f-fa9c-4130-8a00-75bee2323c14 tempest-ProjectReaderTests-1353424500 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:50:51 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-8952b91f-fa9c-4130-8a00-75bee2323c14 tempest-ProjectReaderTests-1353424500 None] Deleted volume successfully. Nov 06 18:50:51 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8952b91f-fa9c-4130-8a00-75bee2323c14 tempest-ProjectReaderTests-1353424500 None] Lock "cinder-dc0e200b-283f-4436-9fcb-1cbb715a5d73-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:01 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=74,cinder:UPDATE=89,cinder:INSERT=22,cinder:DELETE=4 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:51:01 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=75,cinder:UPDATE=85,cinder:INSERT=29,cinder:DELETE=9 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Flow 'volume_create_manager' (e2530bb3-004f-4b2b-855e-12ac33c7ddfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (159aab56-10d6-4617-8485-c5920389d271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (159aab56-10d6-4617-8485-c5920389d271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1478206296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f519705-35ee-4afa-9f77-9a8026c703d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a0773b28f74a419e45b0dc83879356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:04Z,use_quota=True,user_id='b9b258bc908e402090624d2a9a7882ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7366e28-745c-4e6d-b3fa-f4978a599dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7366e28-745c-4e6d-b3fa-f4978a599dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4192b04a-74b2-4047-a031-e0a2f8dc323e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4192b04a-74b2-4047-a031-e0a2f8dc323e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f519705-35ee-4afa-9f77-9a8026c703d7', 'volume_name': 'volume-4f519705-35ee-4afa-9f77-9a8026c703d7', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae0222f-4c20-485a-a5a8-7473b67015f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae0222f-4c20-485a-a5a8-7473b67015f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d108dfb-a5ae-4f99-9ef2-b286bbcdf7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:04 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Volume 4f519705-35ee-4afa-9f77-9a8026c703d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f519705-35ee-4afa-9f77-9a8026c703d7', 'volume_size': 1} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1478206296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f519705-35ee-4afa-9f77-9a8026c703d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a0773b28f74a419e45b0dc83879356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:04Z,use_quota=True,user_id='b9b258bc908e402090624d2a9a7882ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Creating volume 4f519705-35ee-4afa-9f77-9a8026c703d7 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:04 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:04 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7 1073741824 Nov 06 18:51:04 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:04 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Flow 'volume_create_manager' (1367ec5b-cf88-43fa-909d-419a71553211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07019bf-3956-421c-8a17-6036be8ac955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7 1073741824" returned: 0 in 0.584s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07019bf-3956-421c-8a17-6036be8ac955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1626755813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c0e7e27-39d5-42c5-ab06-86c21e044db1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d558b748c56f456895837c588211f8b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:05Z,use_quota=True,user_id='fe98a2f4b8824cbda605d22a493666c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2557ea12-680e-4983-b8f8-e92c084c46ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2557ea12-680e-4983-b8f8-e92c084c46ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c84fedf-14f5-4a9d-ae55-3d3ce40fb251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c84fedf-14f5-4a9d-ae55-3d3ce40fb251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c0e7e27-39d5-42c5-ab06-86c21e044db1', 'volume_name': 'volume-8c0e7e27-39d5-42c5-ab06-86c21e044db1', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9932ecd9-857b-4b8f-89d3-9611ffa085a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9932ecd9-857b-4b8f-89d3-9611ffa085a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92cd252a-92db-477e-8a8e-a6f7268997c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:04 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Volume 8c0e7e27-39d5-42c5-ab06-86c21e044db1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c0e7e27-39d5-42c5-ab06-86c21e044db1', 'volume_size': 1} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:04 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7 Nov 06 18:51:04 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:05 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7" returned: 0 in 0.284s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.315s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1626755813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c0e7e27-39d5-42c5-ab06-86c21e044db1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d558b748c56f456895837c588211f8b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:05Z,use_quota=True,user_id='fe98a2f4b8824cbda605d22a493666c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Creating volume 8c0e7e27-39d5-42c5-ab06-86c21e044db1 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:05 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8c0e7e27-39d5-42c5-ab06-86c21e044db1 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d108dfb-a5ae-4f99-9ef2-b286bbcdf7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f519705-35ee-4afa-9f77-9a8026c703d7', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7ba51a-3cfb-4571-86a4-68afc6421f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:05 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8c0e7e27-39d5-42c5-ab06-86c21e044db1 1073741824 Nov 06 18:51:05 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:05 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Volume volume-4f519705-35ee-4afa-9f77-9a8026c703d7 (4f519705-35ee-4afa-9f77-9a8026c703d7): created successfully Nov 06 18:51:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7ba51a-3cfb-4571-86a4-68afc6421f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Flow 'volume_create_manager' (e2530bb3-004f-4b2b-855e-12ac33c7ddfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:05 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-6946b028-48ae-4218-a9f5-fcb4b3c53da7 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Created volume successfully. Nov 06 18:51:05 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8c0e7e27-39d5-42c5-ab06-86c21e044db1 1073741824" returned: 0 in 0.550s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8c0e7e27-39d5-42c5-ab06-86c21e044db1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:05 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8c0e7e27-39d5-42c5-ab06-86c21e044db1 Nov 06 18:51:05 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:06 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8c0e7e27-39d5-42c5-ab06-86c21e044db1" returned: 0 in 0.304s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92cd252a-92db-477e-8a8e-a6f7268997c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c0e7e27-39d5-42c5-ab06-86c21e044db1', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6892aa63-f54a-4f11-932e-519907d80d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:06 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Volume volume-8c0e7e27-39d5-42c5-ab06-86c21e044db1 (8c0e7e27-39d5-42c5-ab06-86c21e044db1): created successfully Nov 06 18:51:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6892aa63-f54a-4f11-932e-519907d80d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:06 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Flow 'volume_create_manager' (1367ec5b-cf88-43fa-909d-419a71553211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:06 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-e7e02b64-388d-4d57-8c55-52ea465138d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Created volume successfully. Nov 06 18:51:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-85c8a538-3162-48db-87c4-268a386381d5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-85c8a538-3162-48db-87c4-268a386381d5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-85c8a538-3162-48db-87c4-268a386381d5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Creating offline snapshot 64d00dfa-e14a-4bcf-a6ab-1e2c280f9873 of volume 4f519705-35ee-4afa-9f77-9a8026c703d7 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:51:06 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f15a0e-0303-41c7-8d77-d46543e018ec]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85c8a538-3162-48db-87c4-268a386381d5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:06 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7 Nov 06 18:51:06 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:06 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85c8a538-3162-48db-87c4-268a386381d5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7" returned: 0 in 0.446s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85c8a538-3162-48db-87c4-268a386381d5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.64d00dfa-e14a-4bcf-a6ab-1e2c280f9873 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:06 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.64d00dfa-e14a-4bcf-a6ab-1e2c280f9873 1G Nov 06 18:51:06 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:07 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Flow 'volume_create_manager' (acd8794f-5e0b-4ad6-9ee2-298ccc221182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab9580c9-7fa8-4c26-b106-05d5a3e26809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:07 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab9580c9-7fa8-4c26-b106-05d5a3e26809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1064934548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9156cf84-e7c6-407f-a3b5-a9b78ffd5c10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d558b748c56f456895837c588211f8b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:07Z,use_quota=True,user_id='fe98a2f4b8824cbda605d22a493666c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5d2661-b5e6-459e-b691-095f3765c317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5d2661-b5e6-459e-b691-095f3765c317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dfc5a6c-9720-4d15-99d2-332854b73156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dfc5a6c-9720-4d15-99d2-332854b73156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9156cf84-e7c6-407f-a3b5-a9b78ffd5c10', 'volume_name': 'volume-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b2d2ae-89da-4acd-a1ca-e30798561259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b2d2ae-89da-4acd-a1ca-e30798561259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:07 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84639350-943b-4089-a4ab-1de346ffac85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:07 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Volume 9156cf84-e7c6-407f-a3b5-a9b78ffd5c10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10', 'volume_size': 1} Nov 06 18:51:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85c8a538-3162-48db-87c4-268a386381d5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.64d00dfa-e14a-4bcf-a6ab-1e2c280f9873 1G" returned: 0 in 0.748s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85c8a538-3162-48db-87c4-268a386381d5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f519705-35ee-4afa-9f77-9a8026c703d7 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.64d00dfa-e14a-4bcf-a6ab-1e2c280f9873 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:07 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f519705-35ee-4afa-9f77-9a8026c703d7 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.64d00dfa-e14a-4bcf-a6ab-1e2c280f9873 Nov 06 18:51:07 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:08 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Flow 'volume_create_manager' (32270140-c682-41af-a6e1-a9de281576f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62f9d8e-3397-469d-8d65-7ae13a754c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85c8a538-3162-48db-87c4-268a386381d5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f519705-35ee-4afa-9f77-9a8026c703d7 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.64d00dfa-e14a-4bcf-a6ab-1e2c280f9873" returned: 0 in 0.443s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:08 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-85c8a538-3162-48db-87c4-268a386381d5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.64d00dfa-e14a-4bcf-a6ab-1e2c280f9873 is being set with open permissions: ugo+rw Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85c8a538-3162-48db-87c4-268a386381d5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.64d00dfa-e14a-4bcf-a6ab-1e2c280f9873 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:08 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.64d00dfa-e14a-4bcf-a6ab-1e2c280f9873 Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62f9d8e-3397-469d-8d65-7ae13a754c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1302295728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b5de3c5-a9fa-4d1c-8704-5c450906411b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d558b748c56f456895837c588211f8b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:08Z,use_quota=True,user_id='fe98a2f4b8824cbda605d22a493666c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:08 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e0e3e7-bd7d-41d8-a605-d1415b22db6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e0e3e7-bd7d-41d8-a605-d1415b22db6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818364d0-6f37-48a1-a390-777a61cf95c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818364d0-6f37-48a1-a390-777a61cf95c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b5de3c5-a9fa-4d1c-8704-5c450906411b', 'volume_name': 'volume-5b5de3c5-a9fa-4d1c-8704-5c450906411b', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e62ef2c-3f5d-44c6-a612-b282cd9766ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e62ef2c-3f5d-44c6-a612-b282cd9766ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2043be-84fb-4bbf-ae37-93ea7fdca6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:08 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Volume 5b5de3c5-a9fa-4d1c-8704-5c450906411b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b5de3c5-a9fa-4d1c-8704-5c450906411b', 'volume_size': 1} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:08 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85c8a538-3162-48db-87c4-268a386381d5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.64d00dfa-e14a-4bcf-a6ab-1e2c280f9873" returned: 0 in 0.358s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Flow 'volume_create_manager' (17a1313d-9a01-45a5-9e43-a32a10ba14d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ae7b52-6da3-4569-a88b-14cf1d3502be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ae7b52-6da3-4569-a88b-14cf1d3502be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1507393390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2ef590-75c1-4963-8672-11dabf0552db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d558b748c56f456895837c588211f8b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:08Z,use_quota=True,user_id='fe98a2f4b8824cbda605d22a493666c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5aa381-98bd-47a1-b5be-0f019ac92fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5aa381-98bd-47a1-b5be-0f019ac92fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a9a8fe-eef1-44b1-bc27-270684290ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a9a8fe-eef1-44b1-bc27-270684290ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b2ef590-75c1-4963-8672-11dabf0552db', 'volume_name': 'volume-7b2ef590-75c1-4963-8672-11dabf0552db', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34045dd2-2a00-4601-a18f-12cfc1d9048e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34045dd2-2a00-4601-a18f-12cfc1d9048e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58643d4e-7be1-4906-bf86-d6cf23c12a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:08 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Volume 7b2ef590-75c1-4963-8672-11dabf0552db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b2ef590-75c1-4963-8672-11dabf0552db', 'volume_size': 1} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85c8a538-3162-48db-87c4-268a386381d5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:08 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.info Nov 06 18:51:08 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Flow 'volume_create_manager' (d6a96bd7-0122-4ec5-ad10-ffbac1568fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:08 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce71049e-a1b9-4ed0-898d-ca79a6325878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:08 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85c8a538-3162-48db-87c4-268a386381d5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.info" returned: 0 in 0.396s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:09 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-85c8a538-3162-48db-87c4-268a386381d5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.info is being set with open permissions: ugo+rw Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85c8a538-3162-48db-87c4-268a386381d5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce71049e-a1b9-4ed0-898d-ca79a6325878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-457143755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a399a7-c40a-46c8-9cbf-68a09f08cd3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d558b748c56f456895837c588211f8b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:09Z,use_quota=True,user_id='fe98a2f4b8824cbda605d22a493666c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38fee77-94a0-4e91-a6b4-91a6a8cce5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38fee77-94a0-4e91-a6b4-91a6a8cce5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:09 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.info Nov 06 18:51:09 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4118c959-7477-4a09-97b1-5f886585e33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4118c959-7477-4a09-97b1-5f886585e33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69a399a7-c40a-46c8-9cbf-68a09f08cd3e', 'volume_name': 'volume-69a399a7-c40a-46c8-9cbf-68a09f08cd3e', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505dec6e-f6f8-4f02-8283-3dba7812202d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505dec6e-f6f8-4f02-8283-3dba7812202d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9588c8c8-cabb-4c59-a694-9bf9998f254b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:09 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Volume 69a399a7-c40a-46c8-9cbf-68a09f08cd3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69a399a7-c40a-46c8-9cbf-68a09f08cd3e', 'volume_size': 1} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Flow 'volume_create_manager' (065be2a5-bffe-4c27-b445-1d726fd078e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a55cdf98-52c7-4752-876a-a943f4fccac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a55cdf98-52c7-4752-876a-a943f4fccac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1332259906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825e4973-368c-4c53-bed5-c437f101c340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d558b748c56f456895837c588211f8b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:09Z,use_quota=True,user_id='fe98a2f4b8824cbda605d22a493666c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f78aaf4-93fa-4623-b768-95a3d098b714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f78aaf4-93fa-4623-b768-95a3d098b714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a1462c-a003-416e-92f2-5410921c3d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a1462c-a003-416e-92f2-5410921c3d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '825e4973-368c-4c53-bed5-c437f101c340', 'volume_name': 'volume-825e4973-368c-4c53-bed5-c437f101c340', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7cb1442-1a80-45c7-9ac9-83ae28948538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7cb1442-1a80-45c7-9ac9-83ae28948538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1977913-6065-4e5f-a049-35c4d511af48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:09 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Volume 825e4973-368c-4c53-bed5-c437f101c340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-825e4973-368c-4c53-bed5-c437f101c340', 'volume_size': 1} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:09 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-85c8a538-3162-48db-87c4-268a386381d5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.info" returned: 0 in 0.477s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-85c8a538-3162-48db-87c4-268a386381d5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.117s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.883s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1064934548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9156cf84-e7c6-407f-a3b5-a9b78ffd5c10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d558b748c56f456895837c588211f8b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:07Z,use_quota=True,user_id='fe98a2f4b8824cbda605d22a493666c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Creating volume 9156cf84-e7c6-407f-a3b5-a9b78ffd5c10 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:09 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:09 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10 1073741824 Nov 06 18:51:09 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:09 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-85c8a538-3162-48db-87c4-268a386381d5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Create snapshot completed successfully Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Flow 'volume_create_manager' (7a5bc238-fe1a-42cf-9d7f-02c1d0897d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d1090ca-71b5-45d1-af1f-814c03270b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d1090ca-71b5-45d1-af1f-814c03270b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea01095f-3be9-4c46-855d-5d415ff7e9c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb69150a19e431abde80aa8d86bc23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:10Z,use_quota=True,user_id='e2ef0be1d8dc40b89f44e18a1920a7ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f57217d4-0a59-42f3-8e25-03c1890aca22),volume_type_id=f57217d4-0a59-42f3-8e25-03c1890aca22)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68309940-6ebc-4c6d-9ce5-ae456a266d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68309940-6ebc-4c6d-9ce5-ae456a266d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f81523d-bb09-4c76-8af5-e34676fcf42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:09 devstack cinder-volume[86794]: DEBUG cinder.image.glance [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Creating Keystone auth plugin from conf {{(pid=86794) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 18:51:10 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10 1073741824" returned: 0 in 0.512s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:10 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10 Nov 06 18:51:10 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f81523d-bb09-4c76-8af5-e34676fcf42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ea01095f-3be9-4c46-855d-5d415ff7e9c1', 'volume_name': 'volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1', 'volume_size': 1, 'image_id': '4f59c357-d5f6-46c2-811b-77d021f0e922', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f59c357-d5f6-46c2-811b-77d021f0e922', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '409fd892e2fdbf1e073a31c045429d7c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4fb69150a19e431abde80aa8d86bc23a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9aed710da115e7ad8539ea0e83b4eccf5ae0ce40cd6cddf6d5abbea1776ff22dc823893a1ebed050873e3072d5037f1d0940ca2357d1fceecd0b5c92004f1751', 'id': '4f59c357-d5f6-46c2-811b-77d021f0e922', 'created_at': datetime.datetime(2026, 11, 6, 17, 51, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 51, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f59c357-d5f6-46c2-811b-77d021f0e922/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f80bf7d-74e6-48c6-afc7-29ce1fb58176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f80bf7d-74e6-48c6-afc7-29ce1fb58176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:10 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0820de5-0829-4c1d-b89f-39787bbdca77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:10 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Volume ea01095f-3be9-4c46-855d-5d415ff7e9c1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1', 'volume_size': 1, 'image_id': '4f59c357-d5f6-46c2-811b-77d021f0e922', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f59c357-d5f6-46c2-811b-77d021f0e922', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '409fd892e2fdbf1e073a31c045429d7c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4fb69150a19e431abde80aa8d86bc23a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9aed710da115e7ad8539ea0e83b4eccf5ae0ce40cd6cddf6d5abbea1776ff22dc823893a1ebed050873e3072d5037f1d0940ca2357d1fceecd0b5c92004f1751', 'id': '4f59c357-d5f6-46c2-811b-77d021f0e922', 'created_at': datetime.datetime(2026, 11, 6, 17, 51, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 51, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f59c357-d5f6-46c2-811b-77d021f0e922/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Trying to clone ea01095f-3be9-4c46-855d-5d415ff7e9c1 from image 4f59c357-d5f6-46c2-811b-77d021f0e922 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4f59c357-d5f6-46c2-811b-77d021f0e922', 'metadata': {}}]). {{(pid=86794) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Flow 'volume_create_manager' (fc6a0748-5994-4371-88d4-10f405c3b169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55eeb7b8-a213-4cf4-b58a-19a0831ffbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10" returned: 0 in 0.378s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.295s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1302295728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b5de3c5-a9fa-4d1c-8704-5c450906411b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d558b748c56f456895837c588211f8b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:08Z,use_quota=True,user_id='fe98a2f4b8824cbda605d22a493666c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Creating volume 5b5de3c5-a9fa-4d1c-8704-5c450906411b {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:10 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5b5de3c5-a9fa-4d1c-8704-5c450906411b 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55eeb7b8-a213-4cf4-b58a-19a0831ffbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2025422316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7576f6a3-5142-41f3-92da-f72857368b8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a0773b28f74a419e45b0dc83879356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:10Z,use_quota=True,user_id='b9b258bc908e402090624d2a9a7882ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe24f115-31ec-4cf2-95ae-4481d46190e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe24f115-31ec-4cf2-95ae-4481d46190e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ddbee2-1de9-4059-8c9c-d629f0d29c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:10 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5b5de3c5-a9fa-4d1c-8704-5c450906411b 1073741824 Nov 06 18:51:10 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ddbee2-1de9-4059-8c9c-d629f0d29c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7576f6a3-5142-41f3-92da-f72857368b8d', 'volume_name': 'volume-7576f6a3-5142-41f3-92da-f72857368b8d', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d743c08-b268-4de5-ba7a-b7bc8895f2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d743c08-b268-4de5-ba7a-b7bc8895f2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1173062-bb83-4533-b217-a468924c1249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:10 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Volume 7576f6a3-5142-41f3-92da-f72857368b8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7576f6a3-5142-41f3-92da-f72857368b8d', 'volume_size': 1} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 18:51:10 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Image download 0.00 MB at 0.00 MB/s Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84639350-943b-4089-a4ab-1de346ffac85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927a3234-1071-4ebd-a024-74ea2a4c274e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:10 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Volume volume-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10 (9156cf84-e7c6-407f-a3b5-a9b78ffd5c10): created successfully Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927a3234-1071-4ebd-a024-74ea2a4c274e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Flow 'volume_create_manager' (acd8794f-5e0b-4ad6-9ee2-298ccc221182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f780eef-d073-4224-92b8-b891c6486517]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:10 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-dd11dd0a-7fae-4b33-b124-409a1d8cbd1d tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Created volume successfully. Nov 06 18:51:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:10 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD Nov 06 18:51:10 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Flow 'volume_create_manager' (2bcd49ca-6e84-450e-9893-67c48f629c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:11 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d31fd55-0bb8-4a22-b536-a2ca3a03c563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d31fd55-0bb8-4a22-b536-a2ca3a03c563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-948120013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310a968b-bda6-4f92-814a-ff76236a97d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a0773b28f74a419e45b0dc83879356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:11Z,use_quota=True,user_id='b9b258bc908e402090624d2a9a7882ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3e1305-25c0-44e5-8311-46f47c23bbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:11 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3e1305-25c0-44e5-8311-46f47c23bbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f794ee9e-8271-495d-bc0e-5ac185dc17a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f794ee9e-8271-495d-bc0e-5ac185dc17a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '310a968b-bda6-4f92-814a-ff76236a97d1', 'volume_name': 'volume-310a968b-bda6-4f92-814a-ff76236a97d1', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f3158d-a775-48cc-a067-3889e9040b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f3158d-a775-48cc-a067-3889e9040b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29008aef-f4ea-472c-a6c1-fd5506714157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:11 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Volume 310a968b-bda6-4f92-814a-ff76236a97d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-310a968b-bda6-4f92-814a-ff76236a97d1', 'volume_size': 1} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5b5de3c5-a9fa-4d1c-8704-5c450906411b 1073741824" returned: 0 in 0.728s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5b5de3c5-a9fa-4d1c-8704-5c450906411b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:11 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5b5de3c5-a9fa-4d1c-8704-5c450906411b Nov 06 18:51:11 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:11 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD Nov 06 18:51:11 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:11 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5b5de3c5-a9fa-4d1c-8704-5c450906411b" returned: 0 in 0.318s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1507393390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2ef590-75c1-4963-8672-11dabf0552db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d558b748c56f456895837c588211f8b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:08Z,use_quota=True,user_id='fe98a2f4b8824cbda605d22a493666c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Creating volume 7b2ef590-75c1-4963-8672-11dabf0552db {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:11 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7b2ef590-75c1-4963-8672-11dabf0552db 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2043be-84fb-4bbf-ae37-93ea7fdca6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b5de3c5-a9fa-4d1c-8704-5c450906411b', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:11 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7b2ef590-75c1-4963-8672-11dabf0552db 1073741824 Nov 06 18:51:11 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ece88c-c9b5-48c9-adca-cdf0d21dfa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:11 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Volume volume-5b5de3c5-a9fa-4d1c-8704-5c450906411b (5b5de3c5-a9fa-4d1c-8704-5c450906411b): created successfully Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ece88c-c9b5-48c9-adca-cdf0d21dfa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:11 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Flow 'volume_create_manager' (32270140-c682-41af-a6e1-a9de281576f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD" returned: 1 in 0.603s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Temporary image 4f59c357-d5f6-46c2-811b-77d021f0e922 is fetched for user e2ef0be1d8dc40b89f44e18a1920a7ab. {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 18:51:11 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c36066c1-ae08-40f9-b108-c97eab2d49a0 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Created volume successfully. Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4474c3e-9d41-4652-80fc-0fb739b7a681]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Flow 'volume_create_manager' (95edc9e1-a115-4255-8444-71e9705f30e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:11 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD Nov 06 18:51:11 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1313e9-f77f-443d-9355-006cc0e30dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1313e9-f77f-443d-9355-006cc0e30dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1867500347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c60f62-dc92-45f4-8dfb-ad30f21e155f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a2d825e4974b0aa6a265daab4682d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:12Z,use_quota=True,user_id='40d648cb4ea342798df1a2c960e9d938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190015a4-5b45-49ec-a176-b181f3e3e0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190015a4-5b45-49ec-a176-b181f3e3e0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09eabff-e0a7-42f9-a37d-b88f168b2c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09eabff-e0a7-42f9-a37d-b88f168b2c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0c60f62-dc92-45f4-8dfb-ad30f21e155f', 'volume_name': 'volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eeebe66-2262-4d86-ad65-aa61e40346c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eeebe66-2262-4d86-ad65-aa61e40346c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b84e77e-f1e1-42b2-b3e6-ecc8082ede97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Volume c0c60f62-dc92-45f4-8dfb-ad30f21e155f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f', 'volume_size': 1} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Flow 'volume_create_manager' (2c658e39-6e85-4274-ae5a-e094d36c6022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bdf7528-b7b8-4c4a-a827-f70db6c146a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bdf7528-b7b8-4c4a-a827-f70db6c146a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-650386325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb0cf24-f80a-42a6-a2e8-809496ba162a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a0773b28f74a419e45b0dc83879356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:12Z,use_quota=True,user_id='b9b258bc908e402090624d2a9a7882ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1b6450-c377-4b9e-afc5-d94a2485c6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1b6450-c377-4b9e-afc5-d94a2485c6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0dea93e-e369-426f-8b61-8f749904cd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0dea93e-e369-426f-8b61-8f749904cd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfb0cf24-f80a-42a6-a2e8-809496ba162a', 'volume_name': 'volume-dfb0cf24-f80a-42a6-a2e8-809496ba162a', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a686ffa-a552-48cc-ad75-4702a2bb905f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a686ffa-a552-48cc-ad75-4702a2bb905f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10256c97-bb18-4960-af45-8218428700a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Volume dfb0cf24-f80a-42a6-a2e8-809496ba162a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfb0cf24-f80a-42a6-a2e8-809496ba162a', 'volume_size': 1} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:12 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7b2ef590-75c1-4963-8672-11dabf0552db 1073741824" returned: 0 in 0.672s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:12 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7b2ef590-75c1-4963-8672-11dabf0552db {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:12 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7b2ef590-75c1-4963-8672-11dabf0552db Nov 06 18:51:12 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:12 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD Nov 06 18:51:12 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Flow 'volume_create_manager' (4c077d7c-1380-4c30-ba3a-42af37a0c204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3128f26e-6d48-42cc-9808-33b36a1c3f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:12 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Flow 'volume_create_manager' (bc805607-dd5e-4451-9899-10d144b6aa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c597b0e5-f704-426f-ad03-b78da00fceff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3128f26e-6d48-42cc-9808-33b36a1c3f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-690787954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477fa0ce-d4a8-46dc-97df-ba219fec3a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a0773b28f74a419e45b0dc83879356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:12Z,use_quota=True,user_id='b9b258bc908e402090624d2a9a7882ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7d02a4-2fce-4421-bdf3-0d4c4faa6526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7d02a4-2fce-4421-bdf3-0d4c4faa6526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e93c7f9-6f64-40bc-8cee-2c48479ae82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e93c7f9-6f64-40bc-8cee-2c48479ae82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '477fa0ce-d4a8-46dc-97df-ba219fec3a4b', 'volume_name': 'volume-477fa0ce-d4a8-46dc-97df-ba219fec3a4b', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a70eeb-6ff3-4580-841c-6b32ac810914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a70eeb-6ff3-4580-841c-6b32ac810914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1d9a93-5562-44d4-a8b8-e12c484cac85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Volume 477fa0ce-d4a8-46dc-97df-ba219fec3a4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-477fa0ce-d4a8-46dc-97df-ba219fec3a4b', 'volume_size': 1} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7b2ef590-75c1-4963-8672-11dabf0552db" returned: 0 in 0.332s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.528s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-457143755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a399a7-c40a-46c8-9cbf-68a09f08cd3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d558b748c56f456895837c588211f8b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:09Z,use_quota=True,user_id='fe98a2f4b8824cbda605d22a493666c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Creating volume 69a399a7-c40a-46c8-9cbf-68a09f08cd3e {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:12 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69a399a7-c40a-46c8-9cbf-68a09f08cd3e 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:12 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD" returned: 1 in 0.386s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c597b0e5-f704-426f-ad03-b78da00fceff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1643580362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251bc049-55d0-4c46-ab23-3277c8b37406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a0773b28f74a419e45b0dc83879356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:12Z,use_quota=True,user_id='b9b258bc908e402090624d2a9a7882ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbed6b4f-afe5-4831-ad61-6932aa6f6d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69a399a7-c40a-46c8-9cbf-68a09f08cd3e 1073741824 Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbed6b4f-afe5-4831-ad61-6932aa6f6d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:12 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6dc8376-16a6-4c06-b0e6-3a6c6f69334f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6dc8376-16a6-4c06-b0e6-3a6c6f69334f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '251bc049-55d0-4c46-ab23-3277c8b37406', 'volume_name': 'volume-251bc049-55d0-4c46-ab23-3277c8b37406', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b995d7b-85ec-42e5-89ad-6a964edb9e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b995d7b-85ec-42e5-89ad-6a964edb9e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e25a783-3c82-4991-ab38-1411747e4394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Volume 251bc049-55d0-4c46-ab23-3277c8b37406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-251bc049-55d0-4c46-ab23-3277c8b37406', 'volume_size': 1} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58643d4e-7be1-4906-bf86-d6cf23c12a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b2ef590-75c1-4963-8672-11dabf0552db', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf75fb2-9102-4617-9ef8-e253433afe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:12 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Volume volume-7b2ef590-75c1-4963-8672-11dabf0552db (7b2ef590-75c1-4963-8672-11dabf0552db): created successfully Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf75fb2-9102-4617-9ef8-e253433afe80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:12 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Flow 'volume_create_manager' (17a1313d-9a01-45a5-9e43-a32a10ba14d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:12 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-76f4d4dd-11db-422d-b911-1cf90541f2d3 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Created volume successfully. Nov 06 18:51:13 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69a399a7-c40a-46c8-9cbf-68a09f08cd3e 1073741824" returned: 0 in 0.420s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69a399a7-c40a-46c8-9cbf-68a09f08cd3e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:13 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69a399a7-c40a-46c8-9cbf-68a09f08cd3e Nov 06 18:51:13 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:13 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69a399a7-c40a-46c8-9cbf-68a09f08cd3e" returned: 0 in 0.249s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.923s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1332259906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825e4973-368c-4c53-bed5-c437f101c340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d558b748c56f456895837c588211f8b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:09Z,use_quota=True,user_id='fe98a2f4b8824cbda605d22a493666c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Creating volume 825e4973-368c-4c53-bed5-c437f101c340 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:13 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-825e4973-368c-4c53-bed5-c437f101c340 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9588c8c8-cabb-4c59-a694-9bf9998f254b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69a399a7-c40a-46c8-9cbf-68a09f08cd3e', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:13 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-825e4973-368c-4c53-bed5-c437f101c340 1073741824 Nov 06 18:51:13 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee9f333-15e1-4245-883d-948c55f27bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:13 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Volume volume-69a399a7-c40a-46c8-9cbf-68a09f08cd3e (69a399a7-c40a-46c8-9cbf-68a09f08cd3e): created successfully Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee9f333-15e1-4245-883d-948c55f27bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Flow 'volume_create_manager' (d6a96bd7-0122-4ec5-ad10-ffbac1568fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:13 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-e64635ad-45eb-45fb-ad4a-5d7af2dc719e tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Created volume successfully. Nov 06 18:51:13 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-825e4973-368c-4c53-bed5-c437f101c340 1073741824" returned: 0 in 0.430s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-825e4973-368c-4c53-bed5-c437f101c340 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:13 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-825e4973-368c-4c53-bed5-c437f101c340 Nov 06 18:51:13 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:14 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-825e4973-368c-4c53-bed5-c437f101c340" returned: 0 in 0.246s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.515s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2025422316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7576f6a3-5142-41f3-92da-f72857368b8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a0773b28f74a419e45b0dc83879356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:10Z,use_quota=True,user_id='b9b258bc908e402090624d2a9a7882ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Creating volume 7576f6a3-5142-41f3-92da-f72857368b8d {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:14 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7576f6a3-5142-41f3-92da-f72857368b8d 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1977913-6065-4e5f-a049-35c4d511af48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-825e4973-368c-4c53-bed5-c437f101c340', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:14 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7576f6a3-5142-41f3-92da-f72857368b8d 1073741824 Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (452ff220-d53d-4e86-8be4-708b0d7472ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:14 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:14 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Volume volume-825e4973-368c-4c53-bed5-c437f101c340 (825e4973-368c-4c53-bed5-c437f101c340): created successfully Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (452ff220-d53d-4e86-8be4-708b0d7472ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Flow 'volume_create_manager' (065be2a5-bffe-4c27-b445-1d726fd078e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:14 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-759d528e-e57f-40cf-93ed-96b036e708fd tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Created volume successfully. Nov 06 18:51:14 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7576f6a3-5142-41f3-92da-f72857368b8d 1073741824" returned: 0 in 0.453s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7576f6a3-5142-41f3-92da-f72857368b8d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:14 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7576f6a3-5142-41f3-92da-f72857368b8d Nov 06 18:51:14 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:14 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7576f6a3-5142-41f3-92da-f72857368b8d" returned: 0 in 0.246s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.641s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-948120013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310a968b-bda6-4f92-814a-ff76236a97d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a0773b28f74a419e45b0dc83879356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:11Z,use_quota=True,user_id='b9b258bc908e402090624d2a9a7882ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Creating volume 310a968b-bda6-4f92-814a-ff76236a97d1 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:14 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-310a968b-bda6-4f92-814a-ff76236a97d1 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1173062-bb83-4533-b217-a468924c1249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7576f6a3-5142-41f3-92da-f72857368b8d', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:14 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-310a968b-bda6-4f92-814a-ff76236a97d1 1073741824 Nov 06 18:51:14 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60580cc2-ff6a-4f44-91e0-3e91ff1d0b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:14 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Volume volume-7576f6a3-5142-41f3-92da-f72857368b8d (7576f6a3-5142-41f3-92da-f72857368b8d): created successfully Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60580cc2-ff6a-4f44-91e0-3e91ff1d0b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:14 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Flow 'volume_create_manager' (fc6a0748-5994-4371-88d4-10f405c3b169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:14 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-86af1bee-c514-4483-9cc3-eb1d5fecc5a8 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Created volume successfully. Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d3bbf9fb-1586-4df1-8b1a-4e15737983fa tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "cinder-825e4973-368c-4c53-bed5-c437f101c340-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d3bbf9fb-1586-4df1-8b1a-4e15737983fa tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-825e4973-368c-4c53-bed5-c437f101c340-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d3bbf9fb-1586-4df1-8b1a-4e15737983fa tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "cinder-quobyte-825e4973-368c-4c53-bed5-c437f101c340" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d3bbf9fb-1586-4df1-8b1a-4e15737983fa tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-quobyte-825e4973-368c-4c53-bed5-c437f101c340" acquired by "delete_volume" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[68674057-c122-4191-a81e-e1bf754baeb9]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d3bbf9fb-1586-4df1-8b1a-4e15737983fa tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-825e4973-368c-4c53-bed5-c437f101c340 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:15 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-825e4973-368c-4c53-bed5-c437f101c340 Nov 06 18:51:15 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:15 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-310a968b-bda6-4f92-814a-ff76236a97d1 1073741824" returned: 0 in 0.450s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-310a968b-bda6-4f92-814a-ff76236a97d1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:15 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-310a968b-bda6-4f92-814a-ff76236a97d1 Nov 06 18:51:15 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:15 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d3bbf9fb-1586-4df1-8b1a-4e15737983fa tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-825e4973-368c-4c53-bed5-c437f101c340" returned: 0 in 0.411s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d3bbf9fb-1586-4df1-8b1a-4e15737983fa tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-825e4973-368c-4c53-bed5-c437f101c340 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:15 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-825e4973-368c-4c53-bed5-c437f101c340 Nov 06 18:51:15 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:15 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-310a968b-bda6-4f92-814a-ff76236a97d1" returned: 0 in 0.300s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.571s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1867500347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c60f62-dc92-45f4-8dfb-ad30f21e155f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a2d825e4974b0aa6a265daab4682d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:12Z,use_quota=True,user_id='40d648cb4ea342798df1a2c960e9d938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Creating volume c0c60f62-dc92-45f4-8dfb-ad30f21e155f {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:15 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29008aef-f4ea-472c-a6c1-fd5506714157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-310a968b-bda6-4f92-814a-ff76236a97d1', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:15 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f 1073741824 Nov 06 18:51:15 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8587a953-a6ad-4e00-921b-0c7e15ba7b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:15 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Volume volume-310a968b-bda6-4f92-814a-ff76236a97d1 (310a968b-bda6-4f92-814a-ff76236a97d1): created successfully Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8587a953-a6ad-4e00-921b-0c7e15ba7b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Flow 'volume_create_manager' (2bcd49ca-6e84-450e-9893-67c48f629c54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:15 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-75995828-7b35-4ffd-b09c-a9475df977d6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Created volume successfully. Nov 06 18:51:15 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d3bbf9fb-1586-4df1-8b1a-4e15737983fa tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-825e4973-368c-4c53-bed5-c437f101c340" returned: 0 in 0.275s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d3bbf9fb-1586-4df1-8b1a-4e15737983fa tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-quobyte-825e4973-368c-4c53-bed5-c437f101c340" released by "delete_volume" :: held 0.733s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-d3bbf9fb-1586-4df1-8b1a-4e15737983fa tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Created reservations ['a35c5798-babe-42c8-b427-9f3f0513d222', 'fe652ced-f8c8-459f-90a9-fc44f207132d', '87f6fc2a-9b6a-499a-aeeb-96e515c70985', '70204fb3-4586-48f2-b3da-7aabbe43a12f'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d3bbf9fb-1586-4df1-8b1a-4e15737983fa tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d3bbf9fb-1586-4df1-8b1a-4e15737983fa tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d3bbf9fb-1586-4df1-8b1a-4e15737983fa tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d3bbf9fb-1586-4df1-8b1a-4e15737983fa tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d3bbf9fb-1586-4df1-8b1a-4e15737983fa tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d3bbf9fb-1586-4df1-8b1a-4e15737983fa tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:16 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:16 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:16 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f 1073741824" returned: 0 in 0.474s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:16 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5471ade8-87f3-46b7-8649-029241f85a2c tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "cinder-69a399a7-c40a-46c8-9cbf-68a09f08cd3e-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:16 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:16 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d3bbf9fb-1586-4df1-8b1a-4e15737983fa tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.266s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-d3bbf9fb-1586-4df1-8b1a-4e15737983fa tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5471ade8-87f3-46b7-8649-029241f85a2c tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-69a399a7-c40a-46c8-9cbf-68a09f08cd3e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:16 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-d3bbf9fb-1586-4df1-8b1a-4e15737983fa tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Deleted volume successfully. Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d3bbf9fb-1586-4df1-8b1a-4e15737983fa tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-825e4973-368c-4c53-bed5-c437f101c340-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5471ade8-87f3-46b7-8649-029241f85a2c tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "cinder-quobyte-69a399a7-c40a-46c8-9cbf-68a09f08cd3e" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5471ade8-87f3-46b7-8649-029241f85a2c tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-quobyte-69a399a7-c40a-46c8-9cbf-68a09f08cd3e" acquired by "delete_volume" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13a5697-f91c-41ac-a115-53d630e7c2fb]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5471ade8-87f3-46b7-8649-029241f85a2c tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69a399a7-c40a-46c8-9cbf-68a09f08cd3e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:16 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69a399a7-c40a-46c8-9cbf-68a09f08cd3e Nov 06 18:51:16 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:16 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f" returned: 0 in 0.292s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.254s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-650386325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb0cf24-f80a-42a6-a2e8-809496ba162a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a0773b28f74a419e45b0dc83879356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:12Z,use_quota=True,user_id='b9b258bc908e402090624d2a9a7882ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Creating volume dfb0cf24-f80a-42a6-a2e8-809496ba162a {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:16 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dfb0cf24-f80a-42a6-a2e8-809496ba162a 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:16 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dfb0cf24-f80a-42a6-a2e8-809496ba162a 1073741824 Nov 06 18:51:16 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b84e77e-f1e1-42b2-b3e6-ecc8082ede97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d07125-e496-4221-b196-8583acb79df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:16 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Volume volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f (c0c60f62-dc92-45f4-8dfb-ad30f21e155f): created successfully Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d07125-e496-4221-b196-8583acb79df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Flow 'volume_create_manager' (95edc9e1-a115-4255-8444-71e9705f30e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:16 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a7a15447-3715-4b98-a6b4-668f844d191f tempest-ProjectMemberTests-1601559702 None] Created volume successfully. Nov 06 18:51:16 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5471ade8-87f3-46b7-8649-029241f85a2c tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69a399a7-c40a-46c8-9cbf-68a09f08cd3e" returned: 0 in 0.409s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5471ade8-87f3-46b7-8649-029241f85a2c tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69a399a7-c40a-46c8-9cbf-68a09f08cd3e {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:16 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69a399a7-c40a-46c8-9cbf-68a09f08cd3e Nov 06 18:51:16 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:17 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dfb0cf24-f80a-42a6-a2e8-809496ba162a 1073741824" returned: 0 in 0.511s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dfb0cf24-f80a-42a6-a2e8-809496ba162a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:17 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5471ade8-87f3-46b7-8649-029241f85a2c tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-69a399a7-c40a-46c8-9cbf-68a09f08cd3e" returned: 0 in 0.303s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:17 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dfb0cf24-f80a-42a6-a2e8-809496ba162a Nov 06 18:51:17 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5471ade8-87f3-46b7-8649-029241f85a2c tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-quobyte-69a399a7-c40a-46c8-9cbf-68a09f08cd3e" released by "delete_volume" :: held 0.767s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-94367024-17ab-45ac-adc3-0a5e71b0fef8 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-5471ade8-87f3-46b7-8649-029241f85a2c tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Created reservations ['51a80d66-32df-447b-9596-7571ad01cdb9', 'fd98de4b-bf6f-47a5-8a48-5c2cead5a9ca', '22653a06-cc8d-4f9e-8bd9-56e2f56dc825', '91004fe9-126a-40af-9a1b-5ed30812c486'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5471ade8-87f3-46b7-8649-029241f85a2c tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5471ade8-87f3-46b7-8649-029241f85a2c tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5471ade8-87f3-46b7-8649-029241f85a2c tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5471ade8-87f3-46b7-8649-029241f85a2c tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5471ade8-87f3-46b7-8649-029241f85a2c tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5471ade8-87f3-46b7-8649-029241f85a2c tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:17 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:17 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:17 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dfb0cf24-f80a-42a6-a2e8-809496ba162a" returned: 0 in 0.273s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.684s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-690787954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477fa0ce-d4a8-46dc-97df-ba219fec3a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a0773b28f74a419e45b0dc83879356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:12Z,use_quota=True,user_id='b9b258bc908e402090624d2a9a7882ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Creating volume 477fa0ce-d4a8-46dc-97df-ba219fec3a4b {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:17 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-477fa0ce-d4a8-46dc-97df-ba219fec3a4b 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10256c97-bb18-4960-af45-8218428700a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb0cf24-f80a-42a6-a2e8-809496ba162a', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197b64fb-8d20-4256-bf33-dfb8f768b5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:17 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-477fa0ce-d4a8-46dc-97df-ba219fec3a4b 1073741824 Nov 06 18:51:17 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-94cbabd9-bd0e-49ea-94f7-993727f59de9 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "cinder-7b2ef590-75c1-4963-8672-11dabf0552db-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:17 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Volume volume-dfb0cf24-f80a-42a6-a2e8-809496ba162a (dfb0cf24-f80a-42a6-a2e8-809496ba162a): created successfully Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197b64fb-8d20-4256-bf33-dfb8f768b5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Flow 'volume_create_manager' (2c658e39-6e85-4274-ae5a-e094d36c6022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-94cbabd9-bd0e-49ea-94f7-993727f59de9 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-7b2ef590-75c1-4963-8672-11dabf0552db-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:17 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-e39c9bf9-5cca-4bc4-ba95-b63e1d8ad338 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Created volume successfully. Nov 06 18:51:17 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5471ade8-87f3-46b7-8649-029241f85a2c tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.281s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-5471ade8-87f3-46b7-8649-029241f85a2c tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-94cbabd9-bd0e-49ea-94f7-993727f59de9 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "cinder-quobyte-7b2ef590-75c1-4963-8672-11dabf0552db" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:17 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-5471ade8-87f3-46b7-8649-029241f85a2c tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Deleted volume successfully. Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-94cbabd9-bd0e-49ea-94f7-993727f59de9 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-quobyte-7b2ef590-75c1-4963-8672-11dabf0552db" acquired by "delete_volume" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5471ade8-87f3-46b7-8649-029241f85a2c tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-69a399a7-c40a-46c8-9cbf-68a09f08cd3e-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[1423b7e2-a1da-460d-980f-dcee9d742ad8]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94cbabd9-bd0e-49ea-94f7-993727f59de9 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7b2ef590-75c1-4963-8672-11dabf0552db {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:17 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7b2ef590-75c1-4963-8672-11dabf0552db Nov 06 18:51:17 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:17 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-477fa0ce-d4a8-46dc-97df-ba219fec3a4b 1073741824" returned: 0 in 0.505s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-477fa0ce-d4a8-46dc-97df-ba219fec3a4b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:17 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-477fa0ce-d4a8-46dc-97df-ba219fec3a4b Nov 06 18:51:17 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:17 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94cbabd9-bd0e-49ea-94f7-993727f59de9 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7b2ef590-75c1-4963-8672-11dabf0552db" returned: 0 in 0.388s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94cbabd9-bd0e-49ea-94f7-993727f59de9 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7b2ef590-75c1-4963-8672-11dabf0552db {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:17 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7b2ef590-75c1-4963-8672-11dabf0552db Nov 06 18:51:17 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:18 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-477fa0ce-d4a8-46dc-97df-ba219fec3a4b" returned: 0 in 0.253s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.453s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea01095f-3be9-4c46-855d-5d415ff7e9c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb69150a19e431abde80aa8d86bc23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:10Z,use_quota=True,user_id='e2ef0be1d8dc40b89f44e18a1920a7ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f57217d4-0a59-42f3-8e25-03c1890aca22),volume_type_id=f57217d4-0a59-42f3-8e25-03c1890aca22)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Creating volume ea01095f-3be9-4c46-855d-5d415ff7e9c1 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:18 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1d9a93-5562-44d4-a8b8-e12c484cac85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-477fa0ce-d4a8-46dc-97df-ba219fec3a4b', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:18 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1 1073741824 Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7d6311-13c6-4276-aa2c-f2488b41d932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:18 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:18 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94cbabd9-bd0e-49ea-94f7-993727f59de9 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7b2ef590-75c1-4963-8672-11dabf0552db" returned: 0 in 0.249s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:18 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Volume volume-477fa0ce-d4a8-46dc-97df-ba219fec3a4b (477fa0ce-d4a8-46dc-97df-ba219fec3a4b): created successfully Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7d6311-13c6-4276-aa2c-f2488b41d932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Flow 'volume_create_manager' (4c077d7c-1380-4c30-ba3a-42af37a0c204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-94cbabd9-bd0e-49ea-94f7-993727f59de9 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-quobyte-7b2ef590-75c1-4963-8672-11dabf0552db" released by "delete_volume" :: held 0.704s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:18 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-fc23fca3-7846-4d2e-8831-ec658dfc979d tempest-CreateVolumesFromSnapshotTest-1488526318 None] Created volume successfully. Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-94cbabd9-bd0e-49ea-94f7-993727f59de9 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Created reservations ['8d3b8f0b-010f-44a4-b7a3-7e529fdcbab6', '913187b6-3b8c-4098-aa21-fa1ee108806a', '4d17cf64-faac-4628-aa1d-682dcffbadba', '73f0ca5d-c3bd-4d34-9146-1e9223053679'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-94cbabd9-bd0e-49ea-94f7-993727f59de9 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-94cbabd9-bd0e-49ea-94f7-993727f59de9 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-94cbabd9-bd0e-49ea-94f7-993727f59de9 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-94cbabd9-bd0e-49ea-94f7-993727f59de9 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-94cbabd9-bd0e-49ea-94f7-993727f59de9 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94cbabd9-bd0e-49ea-94f7-993727f59de9 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:18 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:18 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-690e2bb6-6d8e-4481-a36e-24dce05f0760 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "cinder-5b5de3c5-a9fa-4d1c-8704-5c450906411b-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-690e2bb6-6d8e-4481-a36e-24dce05f0760 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-5b5de3c5-a9fa-4d1c-8704-5c450906411b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:18 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94cbabd9-bd0e-49ea-94f7-993727f59de9 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.284s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-94cbabd9-bd0e-49ea-94f7-993727f59de9 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:18 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:18 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-94cbabd9-bd0e-49ea-94f7-993727f59de9 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Deleted volume successfully. Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1 1073741824" returned: 0 in 0.502s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-690e2bb6-6d8e-4481-a36e-24dce05f0760 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "cinder-quobyte-5b5de3c5-a9fa-4d1c-8704-5c450906411b" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-94cbabd9-bd0e-49ea-94f7-993727f59de9 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-7b2ef590-75c1-4963-8672-11dabf0552db-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-690e2bb6-6d8e-4481-a36e-24dce05f0760 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-quobyte-5b5de3c5-a9fa-4d1c-8704-5c450906411b" acquired by "delete_volume" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[02329df8-9c1e-4029-b1bc-218cbe1b070e]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-690e2bb6-6d8e-4481-a36e-24dce05f0760 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5b5de3c5-a9fa-4d1c-8704-5c450906411b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:18 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1 Nov 06 18:51:18 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:18 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5b5de3c5-a9fa-4d1c-8704-5c450906411b Nov 06 18:51:18 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:18 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1" returned: 0 in 0.266s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.266s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1643580362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251bc049-55d0-4c46-ab23-3277c8b37406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a0773b28f74a419e45b0dc83879356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:12Z,use_quota=True,user_id='b9b258bc908e402090624d2a9a7882ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Creating volume 251bc049-55d0-4c46-ab23-3277c8b37406 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:19 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-251bc049-55d0-4c46-ab23-3277c8b37406 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:19 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-251bc049-55d0-4c46-ab23-3277c8b37406 1073741824 Nov 06 18:51:19 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Attempting download of 4f59c357-d5f6-46c2-811b-77d021f0e922 ((None, [{'url': 'file:///opt/stack/data/glance/images/4f59c357-d5f6-46c2-811b-77d021f0e922', 'metadata': {}}])) to volume ea01095f-3be9-4c46-855d-5d415ff7e9c1. {{(pid=86794) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 18:51:19 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-690e2bb6-6d8e-4481-a36e-24dce05f0760 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5b5de3c5-a9fa-4d1c-8704-5c450906411b" returned: 0 in 0.431s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-690e2bb6-6d8e-4481-a36e-24dce05f0760 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5b5de3c5-a9fa-4d1c-8704-5c450906411b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:19 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5b5de3c5-a9fa-4d1c-8704-5c450906411b Nov 06 18:51:19 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[832f4cf1-971c-4a5f-a690-4d39c9b6ee00]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f59c357-d5f6-46c2-811b-77d021f0e922_ozjoz7km {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:19 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f59c357-d5f6-46c2-811b-77d021f0e922_ozjoz7km Nov 06 18:51:19 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:19 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-690e2bb6-6d8e-4481-a36e-24dce05f0760 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5b5de3c5-a9fa-4d1c-8704-5c450906411b" returned: 0 in 0.284s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-690e2bb6-6d8e-4481-a36e-24dce05f0760 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-quobyte-5b5de3c5-a9fa-4d1c-8704-5c450906411b" released by "delete_volume" :: held 0.778s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:19 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-251bc049-55d0-4c46-ab23-3277c8b37406 1073741824" returned: 0 in 0.508s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-690e2bb6-6d8e-4481-a36e-24dce05f0760 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Created reservations ['d52fe981-7899-47bd-b605-610a8c7a6095', '74367b75-7a97-4831-a763-a85488718a2d', '39d6d4f8-700c-4cf1-8b9b-fc74a53dbaf6', '63e09433-a382-43db-8a0f-c4a2252cc5b1'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:19 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f59c357-d5f6-46c2-811b-77d021f0e922_ozjoz7km" returned: 0 in 0.368s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f59c357-d5f6-46c2-811b-77d021f0e922_ozjoz7km {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-251bc049-55d0-4c46-ab23-3277c8b37406 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:19 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-251bc049-55d0-4c46-ab23-3277c8b37406 Nov 06 18:51:19 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-690e2bb6-6d8e-4481-a36e-24dce05f0760 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-690e2bb6-6d8e-4481-a36e-24dce05f0760 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-690e2bb6-6d8e-4481-a36e-24dce05f0760 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-690e2bb6-6d8e-4481-a36e-24dce05f0760 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-690e2bb6-6d8e-4481-a36e-24dce05f0760 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-690e2bb6-6d8e-4481-a36e-24dce05f0760 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:19 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f59c357-d5f6-46c2-811b-77d021f0e922_ozjoz7km Nov 06 18:51:19 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:19 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:19 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4016c418-677b-43d6-96d7-e05cdc213814 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "cinder-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4016c418-677b-43d6-96d7-e05cdc213814 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:19 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4016c418-677b-43d6-96d7-e05cdc213814 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "cinder-quobyte-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-251bc049-55d0-4c46-ab23-3277c8b37406" returned: 0 in 0.329s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-94367024-17ab-45ac-adc3-0a5e71b0fef8 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.834s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:19 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e25a783-3c82-4991-ab38-1411747e4394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-251bc049-55d0-4c46-ab23-3277c8b37406', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae4735c-1fae-4b2d-abf1-38dd23e96b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:19 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4016c418-677b-43d6-96d7-e05cdc213814 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-quobyte-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10" acquired by "delete_volume" :: waited 0.048s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f59c357-d5f6-46c2-811b-77d021f0e922_ozjoz7km" returned: 1 in 0.401s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f59c357-d5f6-46c2-811b-77d021f0e922_ozjoz7km' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:51:19 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-94367024-17ab-45ac-adc3-0a5e71b0fef8 tempest-ProjectMemberTests-1601559702 None] Creating offline snapshot e1b8d98b-0b8a-4306-9755-0590785b67c9 of volume c0c60f62-dc92-45f4-8dfb-ad30f21e155f {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-690e2bb6-6d8e-4481-a36e-24dce05f0760 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.334s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7a8ae1-7c0c-4f92-8a16-f57f5a8c680b]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94442cd-3fbe-44b7-88c2-91499a0b0723]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-690e2bb6-6d8e-4481-a36e-24dce05f0760 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4016c418-677b-43d6-96d7-e05cdc213814 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b10cec8-58e9-49fc-b46a-6585e412112e]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:20 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Volume volume-251bc049-55d0-4c46-ab23-3277c8b37406 (251bc049-55d0-4c46-ab23-3277c8b37406): created successfully Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae4735c-1fae-4b2d-abf1-38dd23e96b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Flow 'volume_create_manager' (bc805607-dd5e-4451-9899-10d144b6aa8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94367024-17ab-45ac-adc3-0a5e71b0fef8 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:20 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-690e2bb6-6d8e-4481-a36e-24dce05f0760 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Deleted volume successfully. Nov 06 18:51:20 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-5a7412ec-bbd6-4346-9609-d656184654f3 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Created volume successfully. Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-690e2bb6-6d8e-4481-a36e-24dce05f0760 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-5b5de3c5-a9fa-4d1c-8704-5c450906411b-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:20 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10 Nov 06 18:51:20 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:20 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD Nov 06 18:51:20 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:20 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f Nov 06 18:51:20 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:20 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:20 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4016c418-677b-43d6-96d7-e05cdc213814 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10" returned: 0 in 0.423s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4016c418-677b-43d6-96d7-e05cdc213814 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:20 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94367024-17ab-45ac-adc3-0a5e71b0fef8 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f" returned: 0 in 0.413s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94367024-17ab-45ac-adc3-0a5e71b0fef8 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.e1b8d98b-0b8a-4306-9755-0590785b67c9 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:20 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10 Nov 06 18:51:20 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:20 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.e1b8d98b-0b8a-4306-9755-0590785b67c9 1G Nov 06 18:51:20 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:20 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD Nov 06 18:51:20 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:20 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4016c418-677b-43d6-96d7-e05cdc213814 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10" returned: 0 in 0.275s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:20 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD" returned: 1 in 0.360s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] 4f59c357-d5f6-46c2-811b-77d021f0e922 was raw, converting to qcow2 {{(pid=86794) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4016c418-677b-43d6-96d7-e05cdc213814 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-quobyte-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10" released by "delete_volume" :: held 0.780s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:20 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1 Nov 06 18:51:20 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-4016c418-677b-43d6-96d7-e05cdc213814 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Created reservations ['8b10ae4f-4f19-419a-8d6e-a80a3cabb43a', '01e34e9b-5546-45c3-bd0b-4cf2448de676', '007e2d35-5a78-4f5a-91a3-9499682b1aff', '622f3205-eff0-4913-a61a-cab7532eda49'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4016c418-677b-43d6-96d7-e05cdc213814 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4016c418-677b-43d6-96d7-e05cdc213814 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4016c418-677b-43d6-96d7-e05cdc213814 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4016c418-677b-43d6-96d7-e05cdc213814 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4016c418-677b-43d6-96d7-e05cdc213814 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4016c418-677b-43d6-96d7-e05cdc213814 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:20 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:20 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:20 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94367024-17ab-45ac-adc3-0a5e71b0fef8 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.e1b8d98b-0b8a-4306-9755-0590785b67c9 1G" returned: 0 in 0.453s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94367024-17ab-45ac-adc3-0a5e71b0fef8 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.e1b8d98b-0b8a-4306-9755-0590785b67c9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:20 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.e1b8d98b-0b8a-4306-9755-0590785b67c9 Nov 06 18:51:20 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5743ded7-06d5-41a9-a238-4bac4a326cd8 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "cinder-8c0e7e27-39d5-42c5-ab06-86c21e044db1-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5743ded7-06d5-41a9-a238-4bac4a326cd8 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-8c0e7e27-39d5-42c5-ab06-86c21e044db1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-cfc8b25a-675f-4ac0-bb23-24ae60df43e5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "cinder-251bc049-55d0-4c46-ab23-3277c8b37406-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5743ded7-06d5-41a9-a238-4bac4a326cd8 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "cinder-quobyte-8c0e7e27-39d5-42c5-ab06-86c21e044db1" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-cfc8b25a-675f-4ac0-bb23-24ae60df43e5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-251bc049-55d0-4c46-ab23-3277c8b37406-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5743ded7-06d5-41a9-a238-4bac4a326cd8 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-quobyte-8c0e7e27-39d5-42c5-ab06-86c21e044db1" acquired by "delete_volume" :: waited 0.047s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:21 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4016c418-677b-43d6-96d7-e05cdc213814 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.393s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-4016c418-677b-43d6-96d7-e05cdc213814 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb89fb2-8f90-4a68-81a7-915bcdfcaa3f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5743ded7-06d5-41a9-a238-4bac4a326cd8 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8c0e7e27-39d5-42c5-ab06-86c21e044db1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:21 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-4016c418-677b-43d6-96d7-e05cdc213814 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Deleted volume successfully. Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-cfc8b25a-675f-4ac0-bb23-24ae60df43e5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "cinder-quobyte-251bc049-55d0-4c46-ab23-3277c8b37406" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4016c418-677b-43d6-96d7-e05cdc213814 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-9156cf84-e7c6-407f-a3b5-a9b78ffd5c10-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-cfc8b25a-675f-4ac0-bb23-24ae60df43e5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-quobyte-251bc049-55d0-4c46-ab23-3277c8b37406" acquired by "delete_volume" :: waited 0.030s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:21 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94367024-17ab-45ac-adc3-0a5e71b0fef8 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.e1b8d98b-0b8a-4306-9755-0590785b67c9" returned: 0 in 0.458s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:21 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-94367024-17ab-45ac-adc3-0a5e71b0fef8 tempest-ProjectMemberTests-1601559702 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.e1b8d98b-0b8a-4306-9755-0590785b67c9 is being set with open permissions: ugo+rw Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94367024-17ab-45ac-adc3-0a5e71b0fef8 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.e1b8d98b-0b8a-4306-9755-0590785b67c9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:21 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15c3fb7-1871-4a6d-8ef3-efdf246ea1bb]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cfc8b25a-675f-4ac0-bb23-24ae60df43e5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-251bc049-55d0-4c46-ab23-3277c8b37406 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:21 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.e1b8d98b-0b8a-4306-9755-0590785b67c9 Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1" returned: 0 in 0.672s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:21 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4f59c357-d5f6-46c2-811b-77d021f0e922_us1esh8cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1 {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:51:21 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 18:51:21 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8c0e7e27-39d5-42c5-ab06-86c21e044db1 Nov 06 18:51:21 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:21 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1 1G Nov 06 18:51:21 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:21 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-251bc049-55d0-4c46-ab23-3277c8b37406 Nov 06 18:51:21 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:21 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94367024-17ab-45ac-adc3-0a5e71b0fef8 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.e1b8d98b-0b8a-4306-9755-0590785b67c9" returned: 0 in 0.308s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94367024-17ab-45ac-adc3-0a5e71b0fef8 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:21 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.info Nov 06 18:51:21 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:21 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5743ded7-06d5-41a9-a238-4bac4a326cd8 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8c0e7e27-39d5-42c5-ab06-86c21e044db1" returned: 0 in 0.494s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5743ded7-06d5-41a9-a238-4bac4a326cd8 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8c0e7e27-39d5-42c5-ab06-86c21e044db1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:21 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:21 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8c0e7e27-39d5-42c5-ab06-86c21e044db1 Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1 1G" returned: 0 in 0.399s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Downloaded image 4f59c357-d5f6-46c2-811b-77d021f0e922 ((None, [{'url': 'file:///opt/stack/data/glance/images/4f59c357-d5f6-46c2-811b-77d021f0e922', 'metadata': {}}])) to volume ea01095f-3be9-4c46-855d-5d415ff7e9c1 successfully. {{(pid=86794) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Temporary image 4f59c357-d5f6-46c2-811b-77d021f0e922 for user e2ef0be1d8dc40b89f44e18a1920a7ab is deleted. {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Marking volume ea01095f-3be9-4c46-855d-5d415ff7e9c1 as bootable. {{(pid=86794) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 18:51:21 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:21 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cfc8b25a-675f-4ac0-bb23-24ae60df43e5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-251bc049-55d0-4c46-ab23-3277c8b37406" returned: 0 in 0.446s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cfc8b25a-675f-4ac0-bb23-24ae60df43e5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-251bc049-55d0-4c46-ab23-3277c8b37406 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Copying metadata from image 4f59c357-d5f6-46c2-811b-77d021f0e922 to ea01095f-3be9-4c46-855d-5d415ff7e9c1. {{(pid=86794) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Creating volume glance metadata for volume ea01095f-3be9-4c46-855d-5d415ff7e9c1 backed by image 4f59c357-d5f6-46c2-811b-77d021f0e922 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4f59c357-d5f6-46c2-811b-77d021f0e922', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '409fd892e2fdbf1e073a31c045429d7c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86794) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 18:51:21 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-251bc049-55d0-4c46-ab23-3277c8b37406 Nov 06 18:51:21 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0820de5-0829-4c1d-b89f-39787bbdca77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1', 'volume_size': 1, 'image_id': '4f59c357-d5f6-46c2-811b-77d021f0e922', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f59c357-d5f6-46c2-811b-77d021f0e922', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '409fd892e2fdbf1e073a31c045429d7c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4fb69150a19e431abde80aa8d86bc23a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9aed710da115e7ad8539ea0e83b4eccf5ae0ce40cd6cddf6d5abbea1776ff22dc823893a1ebed050873e3072d5037f1d0940ca2357d1fceecd0b5c92004f1751', 'id': '4f59c357-d5f6-46c2-811b-77d021f0e922', 'created_at': datetime.datetime(2026, 11, 6, 17, 51, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 51, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f59c357-d5f6-46c2-811b-77d021f0e922/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1374967-7dca-44f6-8275-edec4268068c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:21 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Volume volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1 (ea01095f-3be9-4c46-855d-5d415ff7e9c1): created successfully Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1374967-7dca-44f6-8275-edec4268068c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Flow 'volume_create_manager' (7a5bc238-fe1a-42cf-9d7f-02c1d0897d2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:21 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-462b5f52-669c-4369-8b2b-33335c91c72b tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Created volume successfully. Nov 06 18:51:22 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94367024-17ab-45ac-adc3-0a5e71b0fef8 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.info" returned: 0 in 0.327s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:22 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-94367024-17ab-45ac-adc3-0a5e71b0fef8 tempest-ProjectMemberTests-1601559702 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.info is being set with open permissions: ugo+rw Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94367024-17ab-45ac-adc3-0a5e71b0fef8 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:22 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5743ded7-06d5-41a9-a238-4bac4a326cd8 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8c0e7e27-39d5-42c5-ab06-86c21e044db1" returned: 0 in 0.296s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:22 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.info Nov 06 18:51:22 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5743ded7-06d5-41a9-a238-4bac4a326cd8 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-quobyte-8c0e7e27-39d5-42c5-ab06-86c21e044db1" released by "delete_volume" :: held 0.860s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:22 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cfc8b25a-675f-4ac0-bb23-24ae60df43e5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-251bc049-55d0-4c46-ab23-3277c8b37406" returned: 0 in 0.272s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-cfc8b25a-675f-4ac0-bb23-24ae60df43e5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-quobyte-251bc049-55d0-4c46-ab23-3277c8b37406" released by "delete_volume" :: held 0.780s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-5743ded7-06d5-41a9-a238-4bac4a326cd8 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Created reservations ['76539e6c-c242-49d7-8cd9-dd46737dd5c3', '2e654c18-021a-4472-a3ce-929ddfa1f1b3', 'c06e2030-629a-493c-9c31-f595d4bd5c04', 'a122b7f9-dc7e-41ac-b3ca-478b17480516'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-cfc8b25a-675f-4ac0-bb23-24ae60df43e5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Created reservations ['dacbfdbc-57b3-4685-b66d-38dbcaf86bf0', 'c08a2751-a98d-405c-81e6-e648e6925469', '723b656f-8b91-4006-a2ac-589a9d4fbdfb', '04fbd14e-7cad-4b36-87f4-2fc4c7be22ae'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5743ded7-06d5-41a9-a238-4bac4a326cd8 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5743ded7-06d5-41a9-a238-4bac4a326cd8 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5743ded7-06d5-41a9-a238-4bac4a326cd8 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5743ded7-06d5-41a9-a238-4bac4a326cd8 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5743ded7-06d5-41a9-a238-4bac4a326cd8 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5743ded7-06d5-41a9-a238-4bac4a326cd8 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:22 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:22 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cfc8b25a-675f-4ac0-bb23-24ae60df43e5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cfc8b25a-675f-4ac0-bb23-24ae60df43e5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cfc8b25a-675f-4ac0-bb23-24ae60df43e5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cfc8b25a-675f-4ac0-bb23-24ae60df43e5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cfc8b25a-675f-4ac0-bb23-24ae60df43e5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cfc8b25a-675f-4ac0-bb23-24ae60df43e5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:22 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-94367024-17ab-45ac-adc3-0a5e71b0fef8 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.info" returned: 0 in 0.304s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:22 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-94367024-17ab-45ac-adc3-0a5e71b0fef8 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.442s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:22 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ae5dea8b-cc98-4574-a26a-636dc8c68a8a tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "cinder-477fa0ce-d4a8-46dc-97df-ba219fec3a4b-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ae5dea8b-cc98-4574-a26a-636dc8c68a8a tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-477fa0ce-d4a8-46dc-97df-ba219fec3a4b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-94367024-17ab-45ac-adc3-0a5e71b0fef8 tempest-ProjectMemberTests-1601559702 None] Create snapshot completed successfully Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ae5dea8b-cc98-4574-a26a-636dc8c68a8a tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "cinder-quobyte-477fa0ce-d4a8-46dc-97df-ba219fec3a4b" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ae5dea8b-cc98-4574-a26a-636dc8c68a8a tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-quobyte-477fa0ce-d4a8-46dc-97df-ba219fec3a4b" acquired by "delete_volume" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b037675-ad8a-4f2e-9c84-9e2a6c4049cf]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae5dea8b-cc98-4574-a26a-636dc8c68a8a tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-477fa0ce-d4a8-46dc-97df-ba219fec3a4b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:22 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5743ded7-06d5-41a9-a238-4bac4a326cd8 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.314s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-5743ded7-06d5-41a9-a238-4bac4a326cd8 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-5743ded7-06d5-41a9-a238-4bac4a326cd8 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Deleted volume successfully. Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5743ded7-06d5-41a9-a238-4bac4a326cd8 tempest-CreateVolumesFromSourceVolumeTest-864802708 None] Lock "cinder-8c0e7e27-39d5-42c5-ab06-86c21e044db1-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:22 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-477fa0ce-d4a8-46dc-97df-ba219fec3a4b Nov 06 18:51:22 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:22 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cfc8b25a-675f-4ac0-bb23-24ae60df43e5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.352s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cfc8b25a-675f-4ac0-bb23-24ae60df43e5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-cfc8b25a-675f-4ac0-bb23-24ae60df43e5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Deleted volume successfully. Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-860b2914-2e28-4a6e-82e9-4f782c35bfde tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Acquiring lock "cinder-ea01095f-3be9-4c46-855d-5d415ff7e9c1-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-cfc8b25a-675f-4ac0-bb23-24ae60df43e5 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-251bc049-55d0-4c46-ab23-3277c8b37406-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-860b2914-2e28-4a6e-82e9-4f782c35bfde tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Lock "cinder-ea01095f-3be9-4c46-855d-5d415ff7e9c1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-860b2914-2e28-4a6e-82e9-4f782c35bfde tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Acquiring lock "cinder-quobyte-ea01095f-3be9-4c46-855d-5d415ff7e9c1" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-860b2914-2e28-4a6e-82e9-4f782c35bfde tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Lock "cinder-quobyte-ea01095f-3be9-4c46-855d-5d415ff7e9c1" acquired by "delete_volume" :: waited 0.023s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b6e3ee-07d7-4395-bc9f-82c09afa31dc]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-860b2914-2e28-4a6e-82e9-4f782c35bfde tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:22 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1 Nov 06 18:51:22 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:23 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae5dea8b-cc98-4574-a26a-636dc8c68a8a tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-477fa0ce-d4a8-46dc-97df-ba219fec3a4b" returned: 0 in 0.453s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae5dea8b-cc98-4574-a26a-636dc8c68a8a tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-477fa0ce-d4a8-46dc-97df-ba219fec3a4b {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:23 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-477fa0ce-d4a8-46dc-97df-ba219fec3a4b Nov 06 18:51:23 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:23 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae5dea8b-cc98-4574-a26a-636dc8c68a8a tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-477fa0ce-d4a8-46dc-97df-ba219fec3a4b" returned: 0 in 0.244s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ae5dea8b-cc98-4574-a26a-636dc8c68a8a tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-quobyte-477fa0ce-d4a8-46dc-97df-ba219fec3a4b" released by "delete_volume" :: held 0.753s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:23 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-860b2914-2e28-4a6e-82e9-4f782c35bfde tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1" returned: 0 in 0.420s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-860b2914-2e28-4a6e-82e9-4f782c35bfde tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:23 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1 Nov 06 18:51:23 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-ae5dea8b-cc98-4574-a26a-636dc8c68a8a tempest-CreateVolumesFromSnapshotTest-1488526318 None] Created reservations ['2786fd05-c8ab-4a9c-ac29-f424d1a11450', 'a407e14b-9904-4690-998c-72f6d096c2b4', 'e278d043-2698-4a76-bd58-9ef8bd99fe07', '53bddb13-f098-4014-b0ff-f3fa165b43af'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-e1b8d98b-0b8a-4306-9755-0590785b67c9-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-e1b8d98b-0b8a-4306-9755-0590785b67c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-c0c60f62-dc92-45f4-8dfb-ad30f21e155f" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-c0c60f62-dc92-45f4-8dfb-ad30f21e155f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-e1b8d98b-0b8a-4306-9755-0590785b67c9" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ae5dea8b-cc98-4574-a26a-636dc8c68a8a tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ae5dea8b-cc98-4574-a26a-636dc8c68a8a tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ae5dea8b-cc98-4574-a26a-636dc8c68a8a tempest-CreateVolumesFromSnapshotTest-1488526318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-ae5dea8b-cc98-4574-a26a-636dc8c68a8a tempest-CreateVolumesFromSnapshotTest-1488526318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ae5dea8b-cc98-4574-a26a-636dc8c68a8a tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae5dea8b-cc98-4574-a26a-636dc8c68a8a tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-e1b8d98b-0b8a-4306-9755-0590785b67c9" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] Deleting offline snapshot e1b8d98b-0b8a-4306-9755-0590785b67c9 of volume c0c60f62-dc92-45f4-8dfb-ad30f21e155f {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:51:23 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:23 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] snapshot_file for this snap is: volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.e1b8d98b-0b8a-4306-9755-0590785b67c9 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f42f25a-79c5-4861-99b8-e314b12a3725]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.e1b8d98b-0b8a-4306-9755-0590785b67c9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:23 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c1efc0d9-45fc-403b-a5eb-836cbad9578f tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "cinder-dfb0cf24-f80a-42a6-a2e8-809496ba162a-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-860b2914-2e28-4a6e-82e9-4f782c35bfde tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ea01095f-3be9-4c46-855d-5d415ff7e9c1" returned: 0 in 0.343s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-860b2914-2e28-4a6e-82e9-4f782c35bfde tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Lock "cinder-quobyte-ea01095f-3be9-4c46-855d-5d415ff7e9c1" released by "delete_volume" :: held 0.829s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c1efc0d9-45fc-403b-a5eb-836cbad9578f tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-dfb0cf24-f80a-42a6-a2e8-809496ba162a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c1efc0d9-45fc-403b-a5eb-836cbad9578f tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "cinder-quobyte-dfb0cf24-f80a-42a6-a2e8-809496ba162a" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c1efc0d9-45fc-403b-a5eb-836cbad9578f tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-quobyte-dfb0cf24-f80a-42a6-a2e8-809496ba162a" acquired by "delete_volume" :: waited 0.030s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:23 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.e1b8d98b-0b8a-4306-9755-0590785b67c9 Nov 06 18:51:23 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a8e350-1820-4f8f-9175-a84b7104dd84]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c1efc0d9-45fc-403b-a5eb-836cbad9578f tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dfb0cf24-f80a-42a6-a2e8-809496ba162a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-860b2914-2e28-4a6e-82e9-4f782c35bfde tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Created reservations ['f2e763a0-955d-40e2-bf5b-3b885ed146fb', '00fbef26-d66f-4531-b284-51b12cfadd9c', '369c19e0-23d5-440c-b00b-201dfef0f8a0', '2ee26cb8-ba99-4eb5-81f9-5528cdb4bbee'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-860b2914-2e28-4a6e-82e9-4f782c35bfde tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-860b2914-2e28-4a6e-82e9-4f782c35bfde tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-860b2914-2e28-4a6e-82e9-4f782c35bfde tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-860b2914-2e28-4a6e-82e9-4f782c35bfde tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-860b2914-2e28-4a6e-82e9-4f782c35bfde tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-860b2914-2e28-4a6e-82e9-4f782c35bfde tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:23 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dfb0cf24-f80a-42a6-a2e8-809496ba162a Nov 06 18:51:23 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:23 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ae5dea8b-cc98-4574-a26a-636dc8c68a8a tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.494s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:23 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-ae5dea8b-cc98-4574-a26a-636dc8c68a8a tempest-CreateVolumesFromSnapshotTest-1488526318 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:24 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-ae5dea8b-cc98-4574-a26a-636dc8c68a8a tempest-CreateVolumesFromSnapshotTest-1488526318 None] Deleted volume successfully. Nov 06 18:51:24 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:24 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-ae5dea8b-cc98-4574-a26a-636dc8c68a8a tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-477fa0ce-d4a8-46dc-97df-ba219fec3a4b-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:24 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.e1b8d98b-0b8a-4306-9755-0590785b67c9" returned: 0 in 0.565s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c61800a-9fbd-413b-85c6-e2284ceb9dfa]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:24 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-860b2914-2e28-4a6e-82e9-4f782c35bfde tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.377s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-860b2914-2e28-4a6e-82e9-4f782c35bfde tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:24 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-860b2914-2e28-4a6e-82e9-4f782c35bfde tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Deleted volume successfully. Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-860b2914-2e28-4a6e-82e9-4f782c35bfde tempest-VolumeAndVolumeTypeFromImageTest-994328410 None] Lock "cinder-ea01095f-3be9-4c46-855d-5d415ff7e9c1-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:24 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c1efc0d9-45fc-403b-a5eb-836cbad9578f tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dfb0cf24-f80a-42a6-a2e8-809496ba162a" returned: 0 in 0.631s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c1efc0d9-45fc-403b-a5eb-836cbad9578f tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dfb0cf24-f80a-42a6-a2e8-809496ba162a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:24 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f Nov 06 18:51:24 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:24 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dfb0cf24-f80a-42a6-a2e8-809496ba162a Nov 06 18:51:24 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:24 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c1efc0d9-45fc-403b-a5eb-836cbad9578f tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-dfb0cf24-f80a-42a6-a2e8-809496ba162a" returned: 0 in 0.320s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c1efc0d9-45fc-403b-a5eb-836cbad9578f tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-quobyte-dfb0cf24-f80a-42a6-a2e8-809496ba162a" released by "delete_volume" :: held 1.016s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:24 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f" returned: 0 in 0.615s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.e1b8d98b-0b8a-4306-9755-0590785b67c9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:24 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.e1b8d98b-0b8a-4306-9755-0590785b67c9 Nov 06 18:51:24 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-c1efc0d9-45fc-403b-a5eb-836cbad9578f tempest-CreateVolumesFromSnapshotTest-1488526318 None] Created reservations ['3fc91f80-045e-4fc6-8eb3-1ad9d6569a4c', '36146cd3-ede5-4386-8030-671354205103', 'bc639c74-c2bc-46de-9c44-fab715b1b91a', '9cb29513-244b-4fdf-94ba-981652ebb501'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c1efc0d9-45fc-403b-a5eb-836cbad9578f tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c1efc0d9-45fc-403b-a5eb-836cbad9578f tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c1efc0d9-45fc-403b-a5eb-836cbad9578f tempest-CreateVolumesFromSnapshotTest-1488526318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c1efc0d9-45fc-403b-a5eb-836cbad9578f tempest-CreateVolumesFromSnapshotTest-1488526318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c1efc0d9-45fc-403b-a5eb-836cbad9578f tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c1efc0d9-45fc-403b-a5eb-836cbad9578f tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:24 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:24 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:25 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:25 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.e1b8d98b-0b8a-4306-9755-0590785b67c9" returned: 0 in 0.435s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c1efc0d9-45fc-403b-a5eb-836cbad9578f tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.308s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.e1b8d98b-0b8a-4306-9755-0590785b67c9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:25 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-c1efc0d9-45fc-403b-a5eb-836cbad9578f tempest-CreateVolumesFromSnapshotTest-1488526318 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:25 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c1efc0d9-45fc-403b-a5eb-836cbad9578f tempest-CreateVolumesFromSnapshotTest-1488526318 None] Deleted volume successfully. Nov 06 18:51:25 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.e1b8d98b-0b8a-4306-9755-0590785b67c9 Nov 06 18:51:25 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c1efc0d9-45fc-403b-a5eb-836cbad9578f tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-dfb0cf24-f80a-42a6-a2e8-809496ba162a-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:25 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f.e1b8d98b-0b8a-4306-9755-0590785b67c9" returned: 0 in 0.295s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-e1b8d98b-0b8a-4306-9755-0590785b67c9" released by "_delete_snapshot" :: held 2.084s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-c0c60f62-dc92-45f4-8dfb-ad30f21e155f" released by "delete_snapshot" :: held 2.157s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:25 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] Created reservations ['8ffb4c25-5f37-4a2e-a113-73431cce6a4d', '8140e53e-9319-485a-af17-7a1401f106f9', '0654c76b-3601-4b6b-a788-6dea520298ff', 'c2a05780-b0ea-492f-b916-5d558b296009'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:25 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] Delete snapshot completed successfully. Nov 06 18:51:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8568f914-e3e5-4a8c-a713-4f4f9db23369 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-e1b8d98b-0b8a-4306-9755-0590785b67c9-delete_snapshot" released by "delete_snapshot" :: held 2.326s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5ff76bda-9d12-4b72-8844-a42f64f77ba6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "cinder-310a968b-bda6-4f92-814a-ff76236a97d1-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5ff76bda-9d12-4b72-8844-a42f64f77ba6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-310a968b-bda6-4f92-814a-ff76236a97d1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5ff76bda-9d12-4b72-8844-a42f64f77ba6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "cinder-quobyte-310a968b-bda6-4f92-814a-ff76236a97d1" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:26 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5ff76bda-9d12-4b72-8844-a42f64f77ba6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-quobyte-310a968b-bda6-4f92-814a-ff76236a97d1" acquired by "delete_volume" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:26 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[44627f98-5d14-4d77-a883-a2275e42a4bf]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5ff76bda-9d12-4b72-8844-a42f64f77ba6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-310a968b-bda6-4f92-814a-ff76236a97d1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:26 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-310a968b-bda6-4f92-814a-ff76236a97d1 Nov 06 18:51:26 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:26 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5ff76bda-9d12-4b72-8844-a42f64f77ba6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-310a968b-bda6-4f92-814a-ff76236a97d1" returned: 0 in 0.411s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5ff76bda-9d12-4b72-8844-a42f64f77ba6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-310a968b-bda6-4f92-814a-ff76236a97d1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:26 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-310a968b-bda6-4f92-814a-ff76236a97d1 Nov 06 18:51:26 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:26 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-27448d66-41a7-4e77-b8fb-42f76ddf2f03 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-c0c60f62-dc92-45f4-8dfb-ad30f21e155f-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:26 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-27448d66-41a7-4e77-b8fb-42f76ddf2f03 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-c0c60f62-dc92-45f4-8dfb-ad30f21e155f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:26 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-27448d66-41a7-4e77-b8fb-42f76ddf2f03 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-c0c60f62-dc92-45f4-8dfb-ad30f21e155f" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:26 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-27448d66-41a7-4e77-b8fb-42f76ddf2f03 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-c0c60f62-dc92-45f4-8dfb-ad30f21e155f" acquired by "delete_volume" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:26 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5ff76bda-9d12-4b72-8844-a42f64f77ba6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-310a968b-bda6-4f92-814a-ff76236a97d1" returned: 0 in 0.379s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:26 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5ff76bda-9d12-4b72-8844-a42f64f77ba6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-quobyte-310a968b-bda6-4f92-814a-ff76236a97d1" released by "delete_volume" :: held 0.843s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:26 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aef1819-4c12-435e-b512-ab434b3dacdf]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-27448d66-41a7-4e77-b8fb-42f76ddf2f03 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:26 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-5ff76bda-9d12-4b72-8844-a42f64f77ba6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Created reservations ['871e8a0e-9a2d-490f-a7f4-44f43b5a4135', '75c4ef32-ded4-4d47-9685-e34a5c6a12f6', '07ce5c3d-d7b1-49ea-81b9-1ef362b484cb', '8ac30121-2110-44c9-9137-35626454c69e'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5ff76bda-9d12-4b72-8844-a42f64f77ba6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5ff76bda-9d12-4b72-8844-a42f64f77ba6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5ff76bda-9d12-4b72-8844-a42f64f77ba6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-5ff76bda-9d12-4b72-8844-a42f64f77ba6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5ff76bda-9d12-4b72-8844-a42f64f77ba6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5ff76bda-9d12-4b72-8844-a42f64f77ba6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:27 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:27 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:27 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f Nov 06 18:51:27 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1db1c103-8cb3-4c57-99b3-df0a17cead26 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "cinder-7576f6a3-5142-41f3-92da-f72857368b8d-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1db1c103-8cb3-4c57-99b3-df0a17cead26 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-7576f6a3-5142-41f3-92da-f72857368b8d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1db1c103-8cb3-4c57-99b3-df0a17cead26 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "cinder-quobyte-7576f6a3-5142-41f3-92da-f72857368b8d" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1db1c103-8cb3-4c57-99b3-df0a17cead26 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-quobyte-7576f6a3-5142-41f3-92da-f72857368b8d" acquired by "delete_volume" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:27 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5ff76bda-9d12-4b72-8844-a42f64f77ba6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.337s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-5ff76bda-9d12-4b72-8844-a42f64f77ba6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:27 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-5ff76bda-9d12-4b72-8844-a42f64f77ba6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Deleted volume successfully. Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6385dc-f21b-4c82-a5c3-13073e8738a4]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1db1c103-8cb3-4c57-99b3-df0a17cead26 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7576f6a3-5142-41f3-92da-f72857368b8d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5ff76bda-9d12-4b72-8844-a42f64f77ba6 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-310a968b-bda6-4f92-814a-ff76236a97d1-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:27 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7576f6a3-5142-41f3-92da-f72857368b8d Nov 06 18:51:27 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:27 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-27448d66-41a7-4e77-b8fb-42f76ddf2f03 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f" returned: 0 in 0.759s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-27448d66-41a7-4e77-b8fb-42f76ddf2f03 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:27 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f Nov 06 18:51:27 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:27 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1db1c103-8cb3-4c57-99b3-df0a17cead26 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7576f6a3-5142-41f3-92da-f72857368b8d" returned: 0 in 0.492s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1db1c103-8cb3-4c57-99b3-df0a17cead26 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7576f6a3-5142-41f3-92da-f72857368b8d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:27 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-27448d66-41a7-4e77-b8fb-42f76ddf2f03 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c0c60f62-dc92-45f4-8dfb-ad30f21e155f" returned: 0 in 0.301s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:27 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7576f6a3-5142-41f3-92da-f72857368b8d Nov 06 18:51:27 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-27448d66-41a7-4e77-b8fb-42f76ddf2f03 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-c0c60f62-dc92-45f4-8dfb-ad30f21e155f" released by "delete_volume" :: held 1.154s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-27448d66-41a7-4e77-b8fb-42f76ddf2f03 tempest-ProjectMemberTests-1601559702 None] Created reservations ['90d451b3-045e-4233-8930-edd539b16388', '07803a64-ba30-41f1-86e1-cbe0b8cb18a5', 'fcf19db5-ce8d-4c18-9497-8f1ff9a75406', '98892506-2275-4f6f-988a-62069ed57593'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-27448d66-41a7-4e77-b8fb-42f76ddf2f03 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-27448d66-41a7-4e77-b8fb-42f76ddf2f03 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-27448d66-41a7-4e77-b8fb-42f76ddf2f03 tempest-ProjectMemberTests-1601559702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-27448d66-41a7-4e77-b8fb-42f76ddf2f03 tempest-ProjectMemberTests-1601559702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-27448d66-41a7-4e77-b8fb-42f76ddf2f03 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-27448d66-41a7-4e77-b8fb-42f76ddf2f03 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:28 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:28 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:28 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1db1c103-8cb3-4c57-99b3-df0a17cead26 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-7576f6a3-5142-41f3-92da-f72857368b8d" returned: 0 in 0.358s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1db1c103-8cb3-4c57-99b3-df0a17cead26 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-quobyte-7576f6a3-5142-41f3-92da-f72857368b8d" released by "delete_volume" :: held 0.925s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-1db1c103-8cb3-4c57-99b3-df0a17cead26 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Created reservations ['e1900e86-8525-4d17-a47b-8b52491893bb', 'b634ee98-5bde-4de0-a156-3fd6918a3186', 'bc48e5d3-1ed3-4d34-a10b-4df99ba94f72', 'a6a90f5b-88cc-43ed-b030-1acd9e182db8'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1db1c103-8cb3-4c57-99b3-df0a17cead26 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1db1c103-8cb3-4c57-99b3-df0a17cead26 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1db1c103-8cb3-4c57-99b3-df0a17cead26 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-1db1c103-8cb3-4c57-99b3-df0a17cead26 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1db1c103-8cb3-4c57-99b3-df0a17cead26 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1db1c103-8cb3-4c57-99b3-df0a17cead26 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:28 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:28 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-27448d66-41a7-4e77-b8fb-42f76ddf2f03 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.324s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:28 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-27448d66-41a7-4e77-b8fb-42f76ddf2f03 tempest-ProjectMemberTests-1601559702 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:28 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-27448d66-41a7-4e77-b8fb-42f76ddf2f03 tempest-ProjectMemberTests-1601559702 None] Deleted volume successfully. Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-27448d66-41a7-4e77-b8fb-42f76ddf2f03 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-c0c60f62-dc92-45f4-8dfb-ad30f21e155f-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "cinder-64d00dfa-e14a-4bcf-a6ab-1e2c280f9873-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-64d00dfa-e14a-4bcf-a6ab-1e2c280f9873-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "cinder-quobyte-4f519705-35ee-4afa-9f77-9a8026c703d7" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-quobyte-4f519705-35ee-4afa-9f77-9a8026c703d7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "cinder-quobyte-64d00dfa-e14a-4bcf-a6ab-1e2c280f9873" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-quobyte-64d00dfa-e14a-4bcf-a6ab-1e2c280f9873" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] Deleting offline snapshot 64d00dfa-e14a-4bcf-a6ab-1e2c280f9873 of volume 4f519705-35ee-4afa-9f77-9a8026c703d7 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] snapshot_file for this snap is: volume-4f519705-35ee-4afa-9f77-9a8026c703d7.64d00dfa-e14a-4bcf-a6ab-1e2c280f9873 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:51:28 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1db1c103-8cb3-4c57-99b3-df0a17cead26 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.298s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e68ca36-f5f1-4bec-a2fe-06408b0050c0]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-1db1c103-8cb3-4c57-99b3-df0a17cead26 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.64d00dfa-e14a-4bcf-a6ab-1e2c280f9873 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:28 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-1db1c103-8cb3-4c57-99b3-df0a17cead26 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Deleted volume successfully. Nov 06 18:51:28 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-1db1c103-8cb3-4c57-99b3-df0a17cead26 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-7576f6a3-5142-41f3-92da-f72857368b8d-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:28 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.64d00dfa-e14a-4bcf-a6ab-1e2c280f9873 Nov 06 18:51:28 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:29 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.64d00dfa-e14a-4bcf-a6ab-1e2c280f9873" returned: 0 in 0.445s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f519705-35ee-4afa-9f77-9a8026c703d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79a3940-9052-4e47-9f9f-871049b1cddb]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:29 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7 Nov 06 18:51:29 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:29 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:29 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Flow 'volume_create_manager' (c0de581c-e7ca-46e2-9c41-ecba06751f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf1a00a-e4cc-4a4b-b525-ee88a05ff58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:29 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:29 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.444s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf1a00a-e4cc-4a4b-b525-ee88a05ff58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1105071142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3104592-20b1-4451-a3fd-9886035d3d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a2d825e4974b0aa6a265daab4682d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:30Z,use_quota=True,user_id='40d648cb4ea342798df1a2c960e9d938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765269ad-85aa-4a4a-832e-80df95b90647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765269ad-85aa-4a4a-832e-80df95b90647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e259d5f-6e81-48c3-a435-a4707c26618d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e259d5f-6e81-48c3-a435-a4707c26618d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3104592-20b1-4451-a3fd-9886035d3d58', 'volume_name': 'volume-b3104592-20b1-4451-a3fd-9886035d3d58', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24098343-7b90-4a63-9f3b-fa54fefb1d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24098343-7b90-4a63-9f3b-fa54fefb1d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd690a56-0311-43ad-bf94-0c049f6fc956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:29 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Volume b3104592-20b1-4451-a3fd-9886035d3d58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3104592-20b1-4451-a3fd-9886035d3d58', 'volume_size': 1} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1105071142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3104592-20b1-4451-a3fd-9886035d3d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a2d825e4974b0aa6a265daab4682d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:30Z,use_quota=True,user_id='40d648cb4ea342798df1a2c960e9d938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Creating volume b3104592-20b1-4451-a3fd-9886035d3d58 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:29 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7" returned: 0 in 0.571s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.64d00dfa-e14a-4bcf-a6ab-1e2c280f9873 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 29 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:51:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:51:29 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58 1073741824 Nov 06 18:51:29 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:29 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.64d00dfa-e14a-4bcf-a6ab-1e2c280f9873 Nov 06 18:51:29 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:30 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.64d00dfa-e14a-4bcf-a6ab-1e2c280f9873" returned: 0 in 0.436s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.64d00dfa-e14a-4bcf-a6ab-1e2c280f9873 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:30 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.64d00dfa-e14a-4bcf-a6ab-1e2c280f9873 Nov 06 18:51:30 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:30 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58 1073741824" returned: 0 in 0.587s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Flow 'volume_create_manager' (72841638-eab8-4c9a-bb3b-e3dd6d096677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e332e119-2629-4e7d-9415-2d4fc48dbe3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:30 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58 Nov 06 18:51:30 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e332e119-2629-4e7d-9415-2d4fc48dbe3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1151765136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937d00e5-964c-4b2b-85f1-649ae11bae49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab0c72865d246a2a76a1d36b9c4863a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:30Z,use_quota=True,user_id='0ffdedb51f964fc197b95ee8fdcd96f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8dcf96-1126-4c3a-bdac-229983005d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8dcf96-1126-4c3a-bdac-229983005d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036aec67-94f7-48e6-92f9-b6909e37e8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036aec67-94f7-48e6-92f9-b6909e37e8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '937d00e5-964c-4b2b-85f1-649ae11bae49', 'volume_name': 'volume-937d00e5-964c-4b2b-85f1-649ae11bae49', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e96a68-14dc-403e-af14-08c86f5d78e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e96a68-14dc-403e-af14-08c86f5d78e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b7de18c-1372-4a04-83bf-4d8c8e57b2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:30 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Volume 937d00e5-964c-4b2b-85f1-649ae11bae49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-937d00e5-964c-4b2b-85f1-649ae11bae49', 'volume_size': 1} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:30 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7.64d00dfa-e14a-4bcf-a6ab-1e2c280f9873" returned: 0 in 0.352s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-quobyte-64d00dfa-e14a-4bcf-a6ab-1e2c280f9873" released by "_delete_snapshot" :: held 1.960s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-quobyte-4f519705-35ee-4afa-9f77-9a8026c703d7" released by "delete_snapshot" :: held 1.995s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] Created reservations ['1cb89b09-36be-4018-b1f6-ae9e6170c95a', 'd8685bb4-4c40-4b69-8941-a6fe111262b3', '956c773b-470f-4ead-915f-b849aee23662', '502ae76b-9b52-42cc-bb0a-6f6c5ad3c1ee'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:30 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] Delete snapshot completed successfully. Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-505dd79e-777d-4aac-9ae6-d31c9ca1d92e tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-64d00dfa-e14a-4bcf-a6ab-1e2c280f9873-delete_snapshot" released by "delete_snapshot" :: held 2.204s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:30 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58" returned: 0 in 0.440s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.318s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1151765136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937d00e5-964c-4b2b-85f1-649ae11bae49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab0c72865d246a2a76a1d36b9c4863a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:30Z,use_quota=True,user_id='0ffdedb51f964fc197b95ee8fdcd96f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Creating volume 937d00e5-964c-4b2b-85f1-649ae11bae49 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:30 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-937d00e5-964c-4b2b-85f1-649ae11bae49 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd690a56-0311-43ad-bf94-0c049f6fc956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3104592-20b1-4451-a3fd-9886035d3d58', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306bd142-5efa-4cb8-936a-82ce41daaa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:30 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-937d00e5-964c-4b2b-85f1-649ae11bae49 1073741824 Nov 06 18:51:30 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:30 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Volume volume-b3104592-20b1-4451-a3fd-9886035d3d58 (b3104592-20b1-4451-a3fd-9886035d3d58): created successfully Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306bd142-5efa-4cb8-936a-82ce41daaa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:30 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Flow 'volume_create_manager' (c0de581c-e7ca-46e2-9c41-ecba06751f98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:30 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-26d9a69c-6d97-4c98-a590-2755e5bc2c33 tempest-ProjectMemberTests-1601559702 None] Created volume successfully. Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Flow 'volume_create_manager' (14e052cc-3c96-4646-9d23-bffbf56a9940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39694ea9-bca9-4afb-830a-95413fdbb3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39694ea9-bca9-4afb-830a-95413fdbb3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49ca16f-8093-4f81-94a5-fa8e751d4501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8089a5892db4432b1f7e78037d9d8f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:31Z,use_quota=True,user_id='f0f0d66cf98f48a88fb42387c1512020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a50ea1-b274-4101-a72e-3e2d35e37411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a50ea1-b274-4101-a72e-3e2d35e37411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108317a2-c8b2-481d-8b86-b4f3f8f4e011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.image.glance [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Creating Keystone auth plugin from conf {{(pid=86794) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Flow 'volume_create_manager' (eac3d86f-907a-4869-90cb-8abb3072353a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49442a0e-d937-436d-9888-440ecde5f2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49442a0e-d937-436d-9888-440ecde5f2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1491885128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3069f196-d034-4fda-b52c-e0022dc70d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab0c72865d246a2a76a1d36b9c4863a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:31Z,use_quota=True,user_id='0ffdedb51f964fc197b95ee8fdcd96f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d978b3d6-78d5-41a6-8e61-00d9f3d480e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d978b3d6-78d5-41a6-8e61-00d9f3d480e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86ab00a-54c7-4d5c-9148-2eac1f9f4ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86ab00a-54c7-4d5c-9148-2eac1f9f4ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3069f196-d034-4fda-b52c-e0022dc70d0c', 'volume_name': 'volume-3069f196-d034-4fda-b52c-e0022dc70d0c', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac5f470-0979-457a-81fd-62bd89422aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac5f470-0979-457a-81fd-62bd89422aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42bd2fb-a64e-45aa-9442-8209e136a8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:31 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Volume 3069f196-d034-4fda-b52c-e0022dc70d0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3069f196-d034-4fda-b52c-e0022dc70d0c', 'volume_size': 1} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Flow 'volume_create_manager' (37544a27-b567-445d-a21d-ab3f70750c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62eebcd0-97e4-4066-ae93-30fac515d035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62eebcd0-97e4-4066-ae93-30fac515d035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-858868510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d91915bf-7024-4f79-91c4-aba08d07a08a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab0c72865d246a2a76a1d36b9c4863a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:31Z,use_quota=True,user_id='0ffdedb51f964fc197b95ee8fdcd96f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f91a00-187a-4e6b-9ee9-7872910221dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f91a00-187a-4e6b-9ee9-7872910221dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd7c2df-aeb4-4a54-b215-6a3e64771b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd7c2df-aeb4-4a54-b215-6a3e64771b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd91915bf-7024-4f79-91c4-aba08d07a08a', 'volume_name': 'volume-d91915bf-7024-4f79-91c4-aba08d07a08a', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c47902-3140-4a73-90a4-519c0ee61848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c47902-3140-4a73-90a4-519c0ee61848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939d0961-6186-4017-8e1b-14b41593f71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:31 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Volume d91915bf-7024-4f79-91c4-aba08d07a08a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d91915bf-7024-4f79-91c4-aba08d07a08a', 'volume_size': 1} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:31 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-937d00e5-964c-4b2b-85f1-649ae11bae49 1073741824" returned: 0 in 0.598s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-937d00e5-964c-4b2b-85f1-649ae11bae49 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:31 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-937d00e5-964c-4b2b-85f1-649ae11bae49 Nov 06 18:51:31 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108317a2-c8b2-481d-8b86-b4f3f8f4e011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd49ca16f-8093-4f81-94a5-fa8e751d4501', 'volume_name': 'volume-d49ca16f-8093-4f81-94a5-fa8e751d4501', 'volume_size': 1, 'image_id': '5382bf47-e416-4b06-bf6c-71e58295597a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5382bf47-e416-4b06-bf6c-71e58295597a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e5c56948233c9674407674f471f59075', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c8089a5892db4432b1f7e78037d9d8f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '96683e9098d976b30f1b90bd97a0085866617f9cac7966a8dc58632afb963b69931a633308255fd9baee4bb84ccd61c82a451387201cfdedd6301c0b0cab245f', 'id': '5382bf47-e416-4b06-bf6c-71e58295597a', 'created_at': datetime.datetime(2026, 11, 6, 17, 51, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 51, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5382bf47-e416-4b06-bf6c-71e58295597a/file', 'properties': {}}, 'image_service': }' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f77a7e0-c136-4826-b9da-905f46bf3523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f77a7e0-c136-4826-b9da-905f46bf3523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7034d127-217b-4e90-b5e4-e14ed87b5a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:31 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Volume d49ca16f-8093-4f81-94a5-fa8e751d4501: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d49ca16f-8093-4f81-94a5-fa8e751d4501', 'volume_size': 1, 'image_id': '5382bf47-e416-4b06-bf6c-71e58295597a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5382bf47-e416-4b06-bf6c-71e58295597a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e5c56948233c9674407674f471f59075', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c8089a5892db4432b1f7e78037d9d8f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '96683e9098d976b30f1b90bd97a0085866617f9cac7966a8dc58632afb963b69931a633308255fd9baee4bb84ccd61c82a451387201cfdedd6301c0b0cab245f', 'id': '5382bf47-e416-4b06-bf6c-71e58295597a', 'created_at': datetime.datetime(2026, 11, 6, 17, 51, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 51, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5382bf47-e416-4b06-bf6c-71e58295597a/file', 'properties': {}}, 'image_service': } Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Trying to clone d49ca16f-8093-4f81-94a5-fa8e751d4501 from image 5382bf47-e416-4b06-bf6c-71e58295597a at location (None, [{'url': 'file:///opt/stack/data/glance/images/5382bf47-e416-4b06-bf6c-71e58295597a', 'metadata': {}}]). {{(pid=86794) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 18:51:31 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Image download 0.00 MB at 0.00 MB/s Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c0cd57-3fb3-488c-9bfe-3b6b0899c0aa]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:31 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Flow 'volume_create_manager' (dba96cfd-3dab-405d-ab1a-d6e16bba310a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452f3a8f-cdba-442e-a25b-85e41d7953c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-937d00e5-964c-4b2b-85f1-649ae11bae49" returned: 0 in 0.393s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.627s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1491885128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3069f196-d034-4fda-b52c-e0022dc70d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab0c72865d246a2a76a1d36b9c4863a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:31Z,use_quota=True,user_id='0ffdedb51f964fc197b95ee8fdcd96f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Creating volume 3069f196-d034-4fda-b52c-e0022dc70d0c {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:31 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3069f196-d034-4fda-b52c-e0022dc70d0c 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:31 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-58bbb058-5db1-4c97-a11f-52e9dca737d0 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "cinder-4f519705-35ee-4afa-9f77-9a8026c703d7-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452f3a8f-cdba-442e-a25b-85e41d7953c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-253240419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab0c72865d246a2a76a1d36b9c4863a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:32Z,use_quota=True,user_id='0ffdedb51f964fc197b95ee8fdcd96f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:32 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3069f196-d034-4fda-b52c-e0022dc70d0c 1073741824 Nov 06 18:51:32 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD Nov 06 18:51:32 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:32 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3412faac-932b-4530-b7e1-72c90e08edad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3412faac-932b-4530-b7e1-72c90e08edad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fa25d0-cf28-4eae-8103-b9de3f9da119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fa25d0-cf28-4eae-8103-b9de3f9da119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5', 'volume_name': 'volume-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf02534-fc25-4820-af8f-4f62ddb8e77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf02534-fc25-4820-af8f-4f62ddb8e77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e6023c-9904-4afe-9aa1-ee7fb810ad27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:32 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Volume 4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5', 'volume_size': 1} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b7de18c-1372-4a04-83bf-4d8c8e57b2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-937d00e5-964c-4b2b-85f1-649ae11bae49', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9afe42-a812-494a-8a90-b2e519699ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-58bbb058-5db1-4c97-a11f-52e9dca737d0 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-4f519705-35ee-4afa-9f77-9a8026c703d7-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:32 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Volume volume-937d00e5-964c-4b2b-85f1-649ae11bae49 (937d00e5-964c-4b2b-85f1-649ae11bae49): created successfully Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9afe42-a812-494a-8a90-b2e519699ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Flow 'volume_create_manager' (72841638-eab8-4c9a-bb3b-e3dd6d096677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:32 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-0a39d188-3bcd-499c-8932-39936ef121ce tempest-CreateVolumesFromImageTest-400258714 None] Created volume successfully. Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-58bbb058-5db1-4c97-a11f-52e9dca737d0 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "cinder-quobyte-4f519705-35ee-4afa-9f77-9a8026c703d7" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-58bbb058-5db1-4c97-a11f-52e9dca737d0 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-quobyte-4f519705-35ee-4afa-9f77-9a8026c703d7" acquired by "delete_volume" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35edf7f-0871-4e1e-96ba-6d5792a20b9e]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58bbb058-5db1-4c97-a11f-52e9dca737d0 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:32 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Flow 'volume_create_manager' (43652bce-78fc-4f4f-901a-c9db4124a571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f9ee68-d9d6-4e78-bfc7-884b1d9bddba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD" returned: 0 in 0.613s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:32 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7 Nov 06 18:51:32 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f9ee68-d9d6-4e78-bfc7-884b1d9bddba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-355274837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9504cb35-776f-4db2-991a-e55673ba4300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab0c72865d246a2a76a1d36b9c4863a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:32Z,use_quota=True,user_id='0ffdedb51f964fc197b95ee8fdcd96f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731b8089-42cf-44f4-9a98-272dcfd0ec78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731b8089-42cf-44f4-9a98-272dcfd0ec78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48c70ff-2287-425a-a7a8-a3f87444ad50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48c70ff-2287-425a-a7a8-a3f87444ad50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9504cb35-776f-4db2-991a-e55673ba4300', 'volume_name': 'volume-9504cb35-776f-4db2-991a-e55673ba4300', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05225e8-15d1-40e2-baf4-d737ad56688e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05225e8-15d1-40e2-baf4-d737ad56688e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04dd13c-67b7-4312-9dfc-5f34212bd503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:32 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Volume 9504cb35-776f-4db2-991a-e55673ba4300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9504cb35-776f-4db2-991a-e55673ba4300', 'volume_size': 1} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5e95d562-1f70-494f-9a69-8bad073e5eea tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:32 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD Nov 06 18:51:32 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:32 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3069f196-d034-4fda-b52c-e0022dc70d0c 1073741824" returned: 0 in 0.768s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3069f196-d034-4fda-b52c-e0022dc70d0c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:32 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58bbb058-5db1-4c97-a11f-52e9dca737d0 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7" returned: 0 in 0.459s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58bbb058-5db1-4c97-a11f-52e9dca737d0 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:32 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3069f196-d034-4fda-b52c-e0022dc70d0c Nov 06 18:51:32 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:32 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7 Nov 06 18:51:32 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:32 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD" returned: 1 in 0.406s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Temporary image 5382bf47-e416-4b06-bf6c-71e58295597a is fetched for user f0f0d66cf98f48a88fb42387c1512020. {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c643b5-52fd-4555-a240-56a921346e9f]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:33 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3069f196-d034-4fda-b52c-e0022dc70d0c" returned: 0 in 0.275s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.584s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-858868510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d91915bf-7024-4f79-91c4-aba08d07a08a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab0c72865d246a2a76a1d36b9c4863a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:31Z,use_quota=True,user_id='0ffdedb51f964fc197b95ee8fdcd96f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Creating volume d91915bf-7024-4f79-91c4-aba08d07a08a {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:33 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d91915bf-7024-4f79-91c4-aba08d07a08a 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:33 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58bbb058-5db1-4c97-a11f-52e9dca737d0 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4f519705-35ee-4afa-9f77-9a8026c703d7" returned: 0 in 0.288s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:33 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD Nov 06 18:51:33 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:33 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d91915bf-7024-4f79-91c4-aba08d07a08a 1073741824 Nov 06 18:51:33 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42bd2fb-a64e-45aa-9442-8209e136a8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3069f196-d034-4fda-b52c-e0022dc70d0c', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0c44f9-f33d-4039-aead-02fe8df786d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-58bbb058-5db1-4c97-a11f-52e9dca737d0 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-quobyte-4f519705-35ee-4afa-9f77-9a8026c703d7" released by "delete_volume" :: held 0.896s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:33 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Volume volume-3069f196-d034-4fda-b52c-e0022dc70d0c (3069f196-d034-4fda-b52c-e0022dc70d0c): created successfully Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0c44f9-f33d-4039-aead-02fe8df786d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Flow 'volume_create_manager' (eac3d86f-907a-4869-90cb-8abb3072353a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:33 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-0ff01316-152c-4066-8a2c-eafcbb2a7ac7 tempest-CreateVolumesFromImageTest-400258714 None] Created volume successfully. Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-58bbb058-5db1-4c97-a11f-52e9dca737d0 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Created reservations ['ee3d3179-f183-4d14-a6d1-79f4747bdb3a', '54416544-fcbd-4da0-9d1a-351fc3438471', '863f1ac7-ffc8-4ae2-ba06-c42d11896db5', '2cde2723-80bb-4d5e-b741-a4083e4f385e'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-58bbb058-5db1-4c97-a11f-52e9dca737d0 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-58bbb058-5db1-4c97-a11f-52e9dca737d0 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-58bbb058-5db1-4c97-a11f-52e9dca737d0 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-58bbb058-5db1-4c97-a11f-52e9dca737d0 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-58bbb058-5db1-4c97-a11f-52e9dca737d0 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58bbb058-5db1-4c97-a11f-52e9dca737d0 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:33 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:33 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:33 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:33 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD Nov 06 18:51:33 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:33 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-58bbb058-5db1-4c97-a11f-52e9dca737d0 tempest-CreateVolumesFromSnapshotTest-1488526318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.285s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-58bbb058-5db1-4c97-a11f-52e9dca737d0 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:33 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d91915bf-7024-4f79-91c4-aba08d07a08a 1073741824" returned: 0 in 0.519s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:33 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-58bbb058-5db1-4c97-a11f-52e9dca737d0 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Deleted volume successfully. Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-58bbb058-5db1-4c97-a11f-52e9dca737d0 tempest-CreateVolumesFromSnapshotTest-1488526318 None] Lock "cinder-4f519705-35ee-4afa-9f77-9a8026c703d7-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d91915bf-7024-4f79-91c4-aba08d07a08a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:33 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d91915bf-7024-4f79-91c4-aba08d07a08a Nov 06 18:51:33 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:33 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD" returned: 1 in 0.377s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:33 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d91915bf-7024-4f79-91c4-aba08d07a08a" returned: 0 in 0.264s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.807s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-253240419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab0c72865d246a2a76a1d36b9c4863a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:32Z,use_quota=True,user_id='0ffdedb51f964fc197b95ee8fdcd96f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Creating volume 4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:33 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939d0961-6186-4017-8e1b-14b41593f71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d91915bf-7024-4f79-91c4-aba08d07a08a', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:33 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5 1073741824 Nov 06 18:51:33 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (275bfde8-06b4-4d0c-902b-c5e29a19ee6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:33 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Volume volume-d91915bf-7024-4f79-91c4-aba08d07a08a (d91915bf-7024-4f79-91c4-aba08d07a08a): created successfully Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (275bfde8-06b4-4d0c-902b-c5e29a19ee6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:33 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Flow 'volume_create_manager' (37544a27-b567-445d-a21d-ab3f70750c61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:33 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-7ccd9611-9b18-4e9b-82e0-22ac20ecb162 tempest-CreateVolumesFromImageTest-400258714 None] Created volume successfully. Nov 06 18:51:34 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5 1073741824" returned: 0 in 0.412s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:34 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5 Nov 06 18:51:34 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:34 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5" returned: 0 in 0.260s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.065s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-355274837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9504cb35-776f-4db2-991a-e55673ba4300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab0c72865d246a2a76a1d36b9c4863a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:32Z,use_quota=True,user_id='0ffdedb51f964fc197b95ee8fdcd96f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Creating volume 9504cb35-776f-4db2-991a-e55673ba4300 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:34 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9504cb35-776f-4db2-991a-e55673ba4300 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:34 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9504cb35-776f-4db2-991a-e55673ba4300 1073741824 Nov 06 18:51:34 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e6023c-9904-4afe-9aa1-ee7fb810ad27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d35fb47-8598-4326-9437-999cee7b8a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:34 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Volume volume-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5 (4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5): created successfully Nov 06 18:51:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d35fb47-8598-4326-9437-999cee7b8a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:34 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Flow 'volume_create_manager' (dba96cfd-3dab-405d-ab1a-d6e16bba310a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:34 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-4730ecbd-5c46-4b46-94e4-214310686603 tempest-CreateVolumesFromImageTest-400258714 None] Created volume successfully. Nov 06 18:51:35 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9504cb35-776f-4db2-991a-e55673ba4300 1073741824" returned: 0 in 0.442s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9504cb35-776f-4db2-991a-e55673ba4300 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:35 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9504cb35-776f-4db2-991a-e55673ba4300 Nov 06 18:51:35 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:35 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9504cb35-776f-4db2-991a-e55673ba4300" returned: 0 in 0.260s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5e95d562-1f70-494f-9a69-8bad073e5eea tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.809s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04dd13c-67b7-4312-9dfc-5f34212bd503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9504cb35-776f-4db2-991a-e55673ba4300', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0664563b-db63-46da-96bf-2da687e2ffa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-5e95d562-1f70-494f-9a69-8bad073e5eea tempest-ProjectMemberTests-1601559702 None] Creating offline snapshot 57eb3f4e-4c34-443f-96a9-a630356f669d of volume b3104592-20b1-4451-a3fd-9886035d3d58 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:51:35 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Volume volume-9504cb35-776f-4db2-991a-e55673ba4300 (9504cb35-776f-4db2-991a-e55673ba4300): created successfully Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0664563b-db63-46da-96bf-2da687e2ffa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Flow 'volume_create_manager' (43652bce-78fc-4f4f-901a-c9db4124a571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7badef47-d9b3-40a9-9205-362aba6df639]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e95d562-1f70-494f-9a69-8bad073e5eea tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:35 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-f7de663d-96c0-4465-b635-1c9c00969fb6 tempest-CreateVolumesFromImageTest-400258714 None] Created volume successfully. Nov 06 18:51:35 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58 Nov 06 18:51:35 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f0ab33c2-4738-4018-9fd1-b07075b23817 tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "cinder-9504cb35-776f-4db2-991a-e55673ba4300-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f0ab33c2-4738-4018-9fd1-b07075b23817 tempest-CreateVolumesFromImageTest-400258714 None] Lock "cinder-9504cb35-776f-4db2-991a-e55673ba4300-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f0ab33c2-4738-4018-9fd1-b07075b23817 tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "cinder-quobyte-9504cb35-776f-4db2-991a-e55673ba4300" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f0ab33c2-4738-4018-9fd1-b07075b23817 tempest-CreateVolumesFromImageTest-400258714 None] Lock "cinder-quobyte-9504cb35-776f-4db2-991a-e55673ba4300" acquired by "delete_volume" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:35 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[10115a50-0bee-4abc-8277-82d56823b93a]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f0ab33c2-4738-4018-9fd1-b07075b23817 tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9504cb35-776f-4db2-991a-e55673ba4300 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e95d562-1f70-494f-9a69-8bad073e5eea tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58" returned: 0 in 0.521s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e95d562-1f70-494f-9a69-8bad073e5eea tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.57eb3f4e-4c34-443f-96a9-a630356f669d 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:35 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.57eb3f4e-4c34-443f-96a9-a630356f669d 1G Nov 06 18:51:35 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:36 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9504cb35-776f-4db2-991a-e55673ba4300 Nov 06 18:51:36 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:36 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f0ab33c2-4738-4018-9fd1-b07075b23817 tempest-CreateVolumesFromImageTest-400258714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9504cb35-776f-4db2-991a-e55673ba4300" returned: 0 in 0.407s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f0ab33c2-4738-4018-9fd1-b07075b23817 tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9504cb35-776f-4db2-991a-e55673ba4300 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:36 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9504cb35-776f-4db2-991a-e55673ba4300 Nov 06 18:51:36 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:36 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e95d562-1f70-494f-9a69-8bad073e5eea tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.57eb3f4e-4c34-443f-96a9-a630356f669d 1G" returned: 0 in 0.503s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e95d562-1f70-494f-9a69-8bad073e5eea tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3104592-20b1-4451-a3fd-9886035d3d58 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.57eb3f4e-4c34-443f-96a9-a630356f669d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:36 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3104592-20b1-4451-a3fd-9886035d3d58 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.57eb3f4e-4c34-443f-96a9-a630356f669d Nov 06 18:51:36 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:36 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f0ab33c2-4738-4018-9fd1-b07075b23817 tempest-CreateVolumesFromImageTest-400258714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-9504cb35-776f-4db2-991a-e55673ba4300" returned: 0 in 0.299s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f0ab33c2-4738-4018-9fd1-b07075b23817 tempest-CreateVolumesFromImageTest-400258714 None] Lock "cinder-quobyte-9504cb35-776f-4db2-991a-e55673ba4300" released by "delete_volume" :: held 0.755s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:36 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-f0ab33c2-4738-4018-9fd1-b07075b23817 tempest-CreateVolumesFromImageTest-400258714 None] Created reservations ['d82e4790-20c8-4e65-9e2b-9ef405760ed7', '3e005e10-5d7b-4d52-999b-9ca0cf2bdb42', '3139dcb1-9c1b-48cd-aae9-4a47d3d2b633', '820059ca-cdd9-4bca-9f53-34a9d7216d68'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f0ab33c2-4738-4018-9fd1-b07075b23817 tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f0ab33c2-4738-4018-9fd1-b07075b23817 tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f0ab33c2-4738-4018-9fd1-b07075b23817 tempest-CreateVolumesFromImageTest-400258714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:36 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f0ab33c2-4738-4018-9fd1-b07075b23817 tempest-CreateVolumesFromImageTest-400258714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f0ab33c2-4738-4018-9fd1-b07075b23817 tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f0ab33c2-4738-4018-9fd1-b07075b23817 tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e95d562-1f70-494f-9a69-8bad073e5eea tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3104592-20b1-4451-a3fd-9886035d3d58 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.57eb3f4e-4c34-443f-96a9-a630356f669d" returned: 0 in 0.363s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:36 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-5e95d562-1f70-494f-9a69-8bad073e5eea tempest-ProjectMemberTests-1601559702 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.57eb3f4e-4c34-443f-96a9-a630356f669d is being set with open permissions: ugo+rw Nov 06 18:51:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e95d562-1f70-494f-9a69-8bad073e5eea tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.57eb3f4e-4c34-443f-96a9-a630356f669d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:36 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:36 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:36 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.57eb3f4e-4c34-443f-96a9-a630356f669d Nov 06 18:51:36 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d3c7905b-f3a0-4c5f-a9b1-c3904170f7ad tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "cinder-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d3c7905b-f3a0-4c5f-a9b1-c3904170f7ad tempest-CreateVolumesFromImageTest-400258714 None] Lock "cinder-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:37 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f0ab33c2-4738-4018-9fd1-b07075b23817 tempest-CreateVolumesFromImageTest-400258714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.263s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-f0ab33c2-4738-4018-9fd1-b07075b23817 tempest-CreateVolumesFromImageTest-400258714 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:37 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-f0ab33c2-4738-4018-9fd1-b07075b23817 tempest-CreateVolumesFromImageTest-400258714 None] Deleted volume successfully. Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d3c7905b-f3a0-4c5f-a9b1-c3904170f7ad tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "cinder-quobyte-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d3c7905b-f3a0-4c5f-a9b1-c3904170f7ad tempest-CreateVolumesFromImageTest-400258714 None] Lock "cinder-quobyte-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5" acquired by "delete_volume" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f0ab33c2-4738-4018-9fd1-b07075b23817 tempest-CreateVolumesFromImageTest-400258714 None] Lock "cinder-9504cb35-776f-4db2-991a-e55673ba4300-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[143db2f9-bd80-4d82-b6b5-4b46d7d80a95]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d3c7905b-f3a0-4c5f-a9b1-c3904170f7ad tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:37 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e95d562-1f70-494f-9a69-8bad073e5eea tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.57eb3f4e-4c34-443f-96a9-a630356f669d" returned: 0 in 0.349s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e95d562-1f70-494f-9a69-8bad073e5eea tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:37 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.info Nov 06 18:51:37 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:37 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5 Nov 06 18:51:37 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:37 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e95d562-1f70-494f-9a69-8bad073e5eea tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.info" returned: 0 in 0.304s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:37 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-5e95d562-1f70-494f-9a69-8bad073e5eea tempest-ProjectMemberTests-1601559702 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.info is being set with open permissions: ugo+rw Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e95d562-1f70-494f-9a69-8bad073e5eea tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:37 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.info Nov 06 18:51:37 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Flow 'volume_create_manager' (0022485e-394f-45c2-a561-c88d97d0a27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba6cc651-0a92-4445-a546-21572cf06e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:37 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d3c7905b-f3a0-4c5f-a9b1-c3904170f7ad tempest-CreateVolumesFromImageTest-400258714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5" returned: 0 in 0.466s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d3c7905b-f3a0-4c5f-a9b1-c3904170f7ad tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:37 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5 Nov 06 18:51:37 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba6cc651-0a92-4445-a546-21572cf06e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0065bed2-c956-42c5-80e5-035e70824c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6ed51dff79446c82d5a87e00df90b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:38Z,use_quota=True,user_id='bc1e2d6884614657b35d190fdab8891b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43a8706-9174-46c2-883c-e004a11ee4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43a8706-9174-46c2-883c-e004a11ee4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3138fb5-6819-4a37-ae47-3e55f79c6bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3138fb5-6819-4a37-ae47-3e55f79c6bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0065bed2-c956-42c5-80e5-035e70824c56', 'volume_name': 'volume-0065bed2-c956-42c5-80e5-035e70824c56', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664e5586-d22c-4674-a1b9-cf66ae0ba55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664e5586-d22c-4674-a1b9-cf66ae0ba55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905fe10c-2e88-4361-bf9c-15ef2bcb798e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:37 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Volume 0065bed2-c956-42c5-80e5-035e70824c56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0065bed2-c956-42c5-80e5-035e70824c56', 'volume_size': 1} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:37 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5e95d562-1f70-494f-9a69-8bad073e5eea tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.info" returned: 0 in 0.258s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5e95d562-1f70-494f-9a69-8bad073e5eea tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.437s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.068s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49ca16f-8093-4f81-94a5-fa8e751d4501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8089a5892db4432b1f7e78037d9d8f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:31Z,use_quota=True,user_id='f0f0d66cf98f48a88fb42387c1512020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Creating volume d49ca16f-8093-4f81-94a5-fa8e751d4501 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:37 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d49ca16f-8093-4f81-94a5-fa8e751d4501 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:37 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d49ca16f-8093-4f81-94a5-fa8e751d4501 1073741824 Nov 06 18:51:37 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:37 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-5e95d562-1f70-494f-9a69-8bad073e5eea tempest-ProjectMemberTests-1601559702 None] Create snapshot completed successfully Nov 06 18:51:37 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d3c7905b-f3a0-4c5f-a9b1-c3904170f7ad tempest-CreateVolumesFromImageTest-400258714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5" returned: 0 in 0.261s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d3c7905b-f3a0-4c5f-a9b1-c3904170f7ad tempest-CreateVolumesFromImageTest-400258714 None] Lock "cinder-quobyte-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5" released by "delete_volume" :: held 0.786s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:37 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-d3c7905b-f3a0-4c5f-a9b1-c3904170f7ad tempest-CreateVolumesFromImageTest-400258714 None] Created reservations ['514aea98-8032-4f09-9f6f-64d97be67562', '217ef9f0-13cc-4239-ab7f-570b0c12d093', '923d0e9c-bd15-477f-9b1c-d2047f38511f', '9fd53e4f-4763-40a6-be60-a7a361e6a87c'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d3c7905b-f3a0-4c5f-a9b1-c3904170f7ad tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d3c7905b-f3a0-4c5f-a9b1-c3904170f7ad tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d3c7905b-f3a0-4c5f-a9b1-c3904170f7ad tempest-CreateVolumesFromImageTest-400258714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-d3c7905b-f3a0-4c5f-a9b1-c3904170f7ad tempest-CreateVolumesFromImageTest-400258714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d3c7905b-f3a0-4c5f-a9b1-c3904170f7ad tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d3c7905b-f3a0-4c5f-a9b1-c3904170f7ad tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:38 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:38 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a793c19d-3d1b-4260-a311-dd8d83f47823 tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "cinder-d91915bf-7024-4f79-91c4-aba08d07a08a-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a793c19d-3d1b-4260-a311-dd8d83f47823 tempest-CreateVolumesFromImageTest-400258714 None] Lock "cinder-d91915bf-7024-4f79-91c4-aba08d07a08a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a793c19d-3d1b-4260-a311-dd8d83f47823 tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "cinder-quobyte-d91915bf-7024-4f79-91c4-aba08d07a08a" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a793c19d-3d1b-4260-a311-dd8d83f47823 tempest-CreateVolumesFromImageTest-400258714 None] Lock "cinder-quobyte-d91915bf-7024-4f79-91c4-aba08d07a08a" acquired by "delete_volume" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:38 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d3c7905b-f3a0-4c5f-a9b1-c3904170f7ad tempest-CreateVolumesFromImageTest-400258714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.275s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-d3c7905b-f3a0-4c5f-a9b1-c3904170f7ad tempest-CreateVolumesFromImageTest-400258714 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd4c5e0-b48b-4cdb-b63e-26b40649a531]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:38 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-d3c7905b-f3a0-4c5f-a9b1-c3904170f7ad tempest-CreateVolumesFromImageTest-400258714 None] Deleted volume successfully. Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a793c19d-3d1b-4260-a311-dd8d83f47823 tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d91915bf-7024-4f79-91c4-aba08d07a08a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:38 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d49ca16f-8093-4f81-94a5-fa8e751d4501 1073741824" returned: 0 in 0.514s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-d3c7905b-f3a0-4c5f-a9b1-c3904170f7ad tempest-CreateVolumesFromImageTest-400258714 None] Lock "cinder-4ab0308a-414e-4809-aa2a-2d0e2ba1b4e5-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d49ca16f-8093-4f81-94a5-fa8e751d4501 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:38 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d49ca16f-8093-4f81-94a5-fa8e751d4501 Nov 06 18:51:38 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:38 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d91915bf-7024-4f79-91c4-aba08d07a08a Nov 06 18:51:38 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:38 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d49ca16f-8093-4f81-94a5-fa8e751d4501" returned: 0 in 0.272s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.947s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0065bed2-c956-42c5-80e5-035e70824c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6ed51dff79446c82d5a87e00df90b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:38Z,use_quota=True,user_id='bc1e2d6884614657b35d190fdab8891b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Creating volume 0065bed2-c956-42c5-80e5-035e70824c56 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:38 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0065bed2-c956-42c5-80e5-035e70824c56 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:38 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0065bed2-c956-42c5-80e5-035e70824c56 1073741824 Nov 06 18:51:38 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Attempting download of 5382bf47-e416-4b06-bf6c-71e58295597a ((None, [{'url': 'file:///opt/stack/data/glance/images/5382bf47-e416-4b06-bf6c-71e58295597a', 'metadata': {}}])) to volume d49ca16f-8093-4f81-94a5-fa8e751d4501. {{(pid=86794) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 18:51:38 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a793c19d-3d1b-4260-a311-dd8d83f47823 tempest-CreateVolumesFromImageTest-400258714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d91915bf-7024-4f79-91c4-aba08d07a08a" returned: 0 in 0.430s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a793c19d-3d1b-4260-a311-dd8d83f47823 tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d91915bf-7024-4f79-91c4-aba08d07a08a {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-57eb3f4e-4c34-443f-96a9-a630356f669d-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f676c07-829e-449f-adc1-e073d36aa32f]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:38 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d91915bf-7024-4f79-91c4-aba08d07a08a Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5382bf47-e416-4b06-bf6c-71e58295597a_x26xgj79 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:38 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-57eb3f4e-4c34-443f-96a9-a630356f669d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-b3104592-20b1-4451-a3fd-9886035d3d58" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-b3104592-20b1-4451-a3fd-9886035d3d58" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-57eb3f4e-4c34-443f-96a9-a630356f669d" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-57eb3f4e-4c34-443f-96a9-a630356f669d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] Deleting offline snapshot 57eb3f4e-4c34-443f-96a9-a630356f669d of volume b3104592-20b1-4451-a3fd-9886035d3d58 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] snapshot_file for this snap is: volume-b3104592-20b1-4451-a3fd-9886035d3d58.57eb3f4e-4c34-443f-96a9-a630356f669d {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b96145d-ff7e-4652-9601-2b527e469604]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.57eb3f4e-4c34-443f-96a9-a630356f669d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:38 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5382bf47-e416-4b06-bf6c-71e58295597a_x26xgj79 Nov 06 18:51:38 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:39 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a793c19d-3d1b-4260-a311-dd8d83f47823 tempest-CreateVolumesFromImageTest-400258714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d91915bf-7024-4f79-91c4-aba08d07a08a" returned: 0 in 0.291s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:39 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.57eb3f4e-4c34-443f-96a9-a630356f669d Nov 06 18:51:39 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a793c19d-3d1b-4260-a311-dd8d83f47823 tempest-CreateVolumesFromImageTest-400258714 None] Lock "cinder-quobyte-d91915bf-7024-4f79-91c4-aba08d07a08a" released by "delete_volume" :: held 0.777s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-a793c19d-3d1b-4260-a311-dd8d83f47823 tempest-CreateVolumesFromImageTest-400258714 None] Created reservations ['6286248d-2335-4b03-a878-13cb55dde279', '43f4d428-039c-479f-a76a-771d230ba339', 'aa77c9de-f9c6-409b-b996-c220e730c6f3', 'f509aec2-7174-4c46-aa0b-9a49f6811c8f'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:39 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5382bf47-e416-4b06-bf6c-71e58295597a_x26xgj79" returned: 0 in 0.396s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5382bf47-e416-4b06-bf6c-71e58295597a_x26xgj79 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a793c19d-3d1b-4260-a311-dd8d83f47823 tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a793c19d-3d1b-4260-a311-dd8d83f47823 tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a793c19d-3d1b-4260-a311-dd8d83f47823 tempest-CreateVolumesFromImageTest-400258714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:39 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a793c19d-3d1b-4260-a311-dd8d83f47823 tempest-CreateVolumesFromImageTest-400258714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a793c19d-3d1b-4260-a311-dd8d83f47823 tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a793c19d-3d1b-4260-a311-dd8d83f47823 tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0065bed2-c956-42c5-80e5-035e70824c56 1073741824" returned: 0 in 0.561s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:39 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:39 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0065bed2-c956-42c5-80e5-035e70824c56 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:39 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0065bed2-c956-42c5-80e5-035e70824c56 Nov 06 18:51:39 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:39 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5382bf47-e416-4b06-bf6c-71e58295597a_x26xgj79 Nov 06 18:51:39 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-656265e6-70ab-4b37-bc88-5f40c30a3c4c tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "cinder-3069f196-d034-4fda-b52c-e0022dc70d0c-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:39 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.57eb3f4e-4c34-443f-96a9-a630356f669d" returned: 0 in 0.517s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3104592-20b1-4451-a3fd-9886035d3d58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-656265e6-70ab-4b37-bc88-5f40c30a3c4c tempest-CreateVolumesFromImageTest-400258714 None] Lock "cinder-3069f196-d034-4fda-b52c-e0022dc70d0c-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2254fad-800d-416d-8629-8c9ce4f43f02]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-656265e6-70ab-4b37-bc88-5f40c30a3c4c tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "cinder-quobyte-3069f196-d034-4fda-b52c-e0022dc70d0c" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:39 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5382bf47-e416-4b06-bf6c-71e58295597a_x26xgj79" returned: 1 in 0.383s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5382bf47-e416-4b06-bf6c-71e58295597a_x26xgj79' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[40970300-3f8b-4ed5-ad8b-a489b7c1ddce]: (4, 'raw') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-656265e6-70ab-4b37-bc88-5f40c30a3c4c tempest-CreateVolumesFromImageTest-400258714 None] Lock "cinder-quobyte-3069f196-d034-4fda-b52c-e0022dc70d0c" acquired by "delete_volume" :: waited 0.057s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:39 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0065bed2-c956-42c5-80e5-035e70824c56" returned: 0 in 0.374s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:39 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb22d7df-c9fa-427f-a891-89b319883415]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-656265e6-70ab-4b37-bc88-5f40c30a3c4c tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3069f196-d034-4fda-b52c-e0022dc70d0c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a793c19d-3d1b-4260-a311-dd8d83f47823 tempest-CreateVolumesFromImageTest-400258714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.461s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905fe10c-2e88-4361-bf9c-15ef2bcb798e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0065bed2-c956-42c5-80e5-035e70824c56', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f24f38-a96f-45b4-b374-72f61f562ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:39 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58 Nov 06 18:51:39 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-a793c19d-3d1b-4260-a311-dd8d83f47823 tempest-CreateVolumesFromImageTest-400258714 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:39 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a793c19d-3d1b-4260-a311-dd8d83f47823 tempest-CreateVolumesFromImageTest-400258714 None] Deleted volume successfully. Nov 06 18:51:39 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Volume volume-0065bed2-c956-42c5-80e5-035e70824c56 (0065bed2-c956-42c5-80e5-035e70824c56): created successfully Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f24f38-a96f-45b4-b374-72f61f562ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Flow 'volume_create_manager' (0022485e-394f-45c2-a561-c88d97d0a27f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:39 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD Nov 06 18:51:39 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:39 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-fbd828b6-0a6b-4ce2-b554-680e2a1af76e tempest-CinderUnicodeTest-1985796729 None] Created volume successfully. Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a793c19d-3d1b-4260-a311-dd8d83f47823 tempest-CreateVolumesFromImageTest-400258714 None] Lock "cinder-d91915bf-7024-4f79-91c4-aba08d07a08a-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:39 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3069f196-d034-4fda-b52c-e0022dc70d0c Nov 06 18:51:39 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:39 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:39 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58" returned: 0 in 0.531s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.57eb3f4e-4c34-443f-96a9-a630356f669d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:40 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.57eb3f4e-4c34-443f-96a9-a630356f669d Nov 06 18:51:40 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:40 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-656265e6-70ab-4b37-bc88-5f40c30a3c4c tempest-CreateVolumesFromImageTest-400258714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3069f196-d034-4fda-b52c-e0022dc70d0c" returned: 0 in 0.415s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-656265e6-70ab-4b37-bc88-5f40c30a3c4c tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3069f196-d034-4fda-b52c-e0022dc70d0c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:40 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD Nov 06 18:51:40 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:40 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3069f196-d034-4fda-b52c-e0022dc70d0c Nov 06 18:51:40 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:40 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] 5382bf47-e416-4b06-bf6c-71e58295597a was raw, converting to qcow2 {{(pid=86794) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d49ca16f-8093-4f81-94a5-fa8e751d4501 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:40 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-656265e6-70ab-4b37-bc88-5f40c30a3c4c tempest-CreateVolumesFromImageTest-400258714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-3069f196-d034-4fda-b52c-e0022dc70d0c" returned: 0 in 0.263s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:40 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d49ca16f-8093-4f81-94a5-fa8e751d4501 Nov 06 18:51:40 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:40 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-656265e6-70ab-4b37-bc88-5f40c30a3c4c tempest-CreateVolumesFromImageTest-400258714 None] Lock "cinder-quobyte-3069f196-d034-4fda-b52c-e0022dc70d0c" released by "delete_volume" :: held 0.758s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.57eb3f4e-4c34-443f-96a9-a630356f669d" returned: 0 in 0.371s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.57eb3f4e-4c34-443f-96a9-a630356f669d {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:40 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.57eb3f4e-4c34-443f-96a9-a630356f669d Nov 06 18:51:40 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-656265e6-70ab-4b37-bc88-5f40c30a3c4c tempest-CreateVolumesFromImageTest-400258714 None] Created reservations ['3aa5c1e8-c7e9-4ef1-a702-0f35342e0ad9', 'dd72b8bf-f84c-4b15-9dee-773d644e0116', '21c048df-f942-4e04-a757-c410c0f91af3', '88e6f4e1-116d-4010-9f1a-83b9ced79e3b'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-656265e6-70ab-4b37-bc88-5f40c30a3c4c tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-656265e6-70ab-4b37-bc88-5f40c30a3c4c tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-656265e6-70ab-4b37-bc88-5f40c30a3c4c tempest-CreateVolumesFromImageTest-400258714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-656265e6-70ab-4b37-bc88-5f40c30a3c4c tempest-CreateVolumesFromImageTest-400258714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-656265e6-70ab-4b37-bc88-5f40c30a3c4c tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-656265e6-70ab-4b37-bc88-5f40c30a3c4c tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:40 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:40 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a1577403-34f0-4cd4-a9be-afce430752fe tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "cinder-937d00e5-964c-4b2b-85f1-649ae11bae49-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a1577403-34f0-4cd4-a9be-afce430752fe tempest-CreateVolumesFromImageTest-400258714 None] Lock "cinder-937d00e5-964c-4b2b-85f1-649ae11bae49-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:40 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58.57eb3f4e-4c34-443f-96a9-a630356f669d" returned: 0 in 0.329s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-57eb3f4e-4c34-443f-96a9-a630356f669d" released by "_delete_snapshot" :: held 1.899s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a1577403-34f0-4cd4-a9be-afce430752fe tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "cinder-quobyte-937d00e5-964c-4b2b-85f1-649ae11bae49" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-b3104592-20b1-4451-a3fd-9886035d3d58" released by "delete_snapshot" :: held 1.947s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a1577403-34f0-4cd4-a9be-afce430752fe tempest-CreateVolumesFromImageTest-400258714 None] Lock "cinder-quobyte-937d00e5-964c-4b2b-85f1-649ae11bae49" acquired by "delete_volume" :: waited 0.042s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe55a847-2329-4c41-a842-0d64070bf948]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a1577403-34f0-4cd4-a9be-afce430752fe tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-937d00e5-964c-4b2b-85f1-649ae11bae49 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:40 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-656265e6-70ab-4b37-bc88-5f40c30a3c4c tempest-CreateVolumesFromImageTest-400258714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.385s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-656265e6-70ab-4b37-bc88-5f40c30a3c4c tempest-CreateVolumesFromImageTest-400258714 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:40 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-656265e6-70ab-4b37-bc88-5f40c30a3c4c tempest-CreateVolumesFromImageTest-400258714 None] Deleted volume successfully. Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] Created reservations ['99ff0c16-9ae5-4e7d-8062-2d1283e296c7', '3d7334e5-d301-4517-a61a-e7cffd3019d6', 'fc204232-d19d-46d1-8ddf-acedb9faf7b2', '35ae0fd9-8a7c-4002-8dc2-f93d88b6831f'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:40 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-656265e6-70ab-4b37-bc88-5f40c30a3c4c tempest-CreateVolumesFromImageTest-400258714 None] Lock "cinder-3069f196-d034-4fda-b52c-e0022dc70d0c-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d49ca16f-8093-4f81-94a5-fa8e751d4501" returned: 0 in 0.646s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5382bf47-e416-4b06-bf6c-71e58295597a_5nyk97yndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d49ca16f-8093-4f81-94a5-fa8e751d4501 {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:51:40 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 18:51:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d49ca16f-8093-4f81-94a5-fa8e751d4501 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:40 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d49ca16f-8093-4f81-94a5-fa8e751d4501 1G Nov 06 18:51:40 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:40 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-937d00e5-964c-4b2b-85f1-649ae11bae49 Nov 06 18:51:40 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:41 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] Delete snapshot completed successfully. Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-90a0ecff-a2e1-42e1-8def-3caaca64d60b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-57eb3f4e-4c34-443f-96a9-a630356f669d-delete_snapshot" released by "delete_snapshot" :: held 2.222s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:41 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a1577403-34f0-4cd4-a9be-afce430752fe tempest-CreateVolumesFromImageTest-400258714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-937d00e5-964c-4b2b-85f1-649ae11bae49" returned: 0 in 0.441s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a1577403-34f0-4cd4-a9be-afce430752fe tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-937d00e5-964c-4b2b-85f1-649ae11bae49 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:41 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-937d00e5-964c-4b2b-85f1-649ae11bae49 Nov 06 18:51:41 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:41 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d49ca16f-8093-4f81-94a5-fa8e751d4501 1G" returned: 0 in 0.378s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Downloaded image 5382bf47-e416-4b06-bf6c-71e58295597a ((None, [{'url': 'file:///opt/stack/data/glance/images/5382bf47-e416-4b06-bf6c-71e58295597a', 'metadata': {}}])) to volume d49ca16f-8093-4f81-94a5-fa8e751d4501 successfully. {{(pid=86794) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Temporary image 5382bf47-e416-4b06-bf6c-71e58295597a for user f0f0d66cf98f48a88fb42387c1512020 is deleted. {{(pid=86794) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.volume_utils [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Marking volume d49ca16f-8093-4f81-94a5-fa8e751d4501 as bootable. {{(pid=86794) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Copying metadata from image 5382bf47-e416-4b06-bf6c-71e58295597a to d49ca16f-8093-4f81-94a5-fa8e751d4501. {{(pid=86794) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Creating volume glance metadata for volume d49ca16f-8093-4f81-94a5-fa8e751d4501 backed by image 5382bf47-e416-4b06-bf6c-71e58295597a with: {'image_id': '5382bf47-e416-4b06-bf6c-71e58295597a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e5c56948233c9674407674f471f59075', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86794) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Flow 'volume_create_manager' (ec6fc364-6e56-4ab9-918a-073f7117fa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612b83fa-fe84-43e7-aa31-6a3a4282e6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612b83fa-fe84-43e7-aa31-6a3a4282e6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1134136392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a984da78-43bb-4de0-a5da-83d141394f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6ed51dff79446c82d5a87e00df90b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:41Z,use_quota=True,user_id='bc1e2d6884614657b35d190fdab8891b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf4cdb0-82b7-4a6e-8424-45d3899e7651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf4cdb0-82b7-4a6e-8424-45d3899e7651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9086e35a-7245-40d9-b5af-ecf53c829d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9086e35a-7245-40d9-b5af-ecf53c829d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a984da78-43bb-4de0-a5da-83d141394f33', 'volume_name': 'volume-a984da78-43bb-4de0-a5da-83d141394f33', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2de624-f5ae-4264-b9b7-4cbe406adee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2de624-f5ae-4264-b9b7-4cbe406adee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3dbdca-8aee-41d9-9f51-2e6d02fd4267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:41 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Volume a984da78-43bb-4de0-a5da-83d141394f33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a984da78-43bb-4de0-a5da-83d141394f33', 'volume_size': 1} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1134136392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a984da78-43bb-4de0-a5da-83d141394f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6ed51dff79446c82d5a87e00df90b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:41Z,use_quota=True,user_id='bc1e2d6884614657b35d190fdab8891b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Creating volume a984da78-43bb-4de0-a5da-83d141394f33 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:41 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7034d127-217b-4e90-b5e4-e14ed87b5a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d49ca16f-8093-4f81-94a5-fa8e751d4501', 'volume_size': 1, 'image_id': '5382bf47-e416-4b06-bf6c-71e58295597a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5382bf47-e416-4b06-bf6c-71e58295597a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e5c56948233c9674407674f471f59075', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c8089a5892db4432b1f7e78037d9d8f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '96683e9098d976b30f1b90bd97a0085866617f9cac7966a8dc58632afb963b69931a633308255fd9baee4bb84ccd61c82a451387201cfdedd6301c0b0cab245f', 'id': '5382bf47-e416-4b06-bf6c-71e58295597a', 'created_at': datetime.datetime(2026, 11, 6, 17, 51, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 51, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5382bf47-e416-4b06-bf6c-71e58295597a/file', 'properties': {}}, 'image_service': }' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6296c3ba-0431-48f1-a2c6-053949cf4aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:41 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33 1073741824 Nov 06 18:51:41 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:41 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a1577403-34f0-4cd4-a9be-afce430752fe tempest-CreateVolumesFromImageTest-400258714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-937d00e5-964c-4b2b-85f1-649ae11bae49" returned: 0 in 0.268s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:41 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Volume volume-d49ca16f-8093-4f81-94a5-fa8e751d4501 (d49ca16f-8093-4f81-94a5-fa8e751d4501): created successfully Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6296c3ba-0431-48f1-a2c6-053949cf4aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Flow 'volume_create_manager' (14e052cc-3c96-4646-9d23-bffbf56a9940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a1577403-34f0-4cd4-a9be-afce430752fe tempest-CreateVolumesFromImageTest-400258714 None] Lock "cinder-quobyte-937d00e5-964c-4b2b-85f1-649ae11bae49" released by "delete_volume" :: held 0.777s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:41 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-219c5a51-b3fd-4810-a7c1-7327288633e7 tempest-VolumeImageDependencyTests-1217452040 None] Created volume successfully. Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-a1577403-34f0-4cd4-a9be-afce430752fe tempest-CreateVolumesFromImageTest-400258714 None] Created reservations ['bc02c7ed-be3a-4009-8ec6-edd161a9bb1d', '72cd74f8-7389-46b2-81e0-4a310c1b09b9', 'ae0af196-025d-4690-a0fa-5e8fee18e27e', 'ad64ccc0-4930-436c-922e-abec9649c634'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a1577403-34f0-4cd4-a9be-afce430752fe tempest-CreateVolumesFromImageTest-400258714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a1577403-34f0-4cd4-a9be-afce430752fe tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a1577403-34f0-4cd4-a9be-afce430752fe tempest-CreateVolumesFromImageTest-400258714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a1577403-34f0-4cd4-a9be-afce430752fe tempest-CreateVolumesFromImageTest-400258714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a1577403-34f0-4cd4-a9be-afce430752fe tempest-CreateVolumesFromImageTest-400258714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a1577403-34f0-4cd4-a9be-afce430752fe tempest-CreateVolumesFromImageTest-400258714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:41 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:41 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f333367d-7772-42e0-a189-b7072581a568 tempest-VolumeImageDependencyTests-1217452040 None] Acquiring lock "cinder-d49ca16f-8093-4f81-94a5-fa8e751d4501-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7c7249a8-22e1-4ae5-8b27-25f9bbbec25b tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-b3104592-20b1-4451-a3fd-9886035d3d58-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:42 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a1577403-34f0-4cd4-a9be-afce430752fe tempest-CreateVolumesFromImageTest-400258714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.309s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-a1577403-34f0-4cd4-a9be-afce430752fe tempest-CreateVolumesFromImageTest-400258714 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f333367d-7772-42e0-a189-b7072581a568 tempest-VolumeImageDependencyTests-1217452040 None] Lock "cinder-d49ca16f-8093-4f81-94a5-fa8e751d4501-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:42 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:42 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a1577403-34f0-4cd4-a9be-afce430752fe tempest-CreateVolumesFromImageTest-400258714 None] Deleted volume successfully. Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7c7249a8-22e1-4ae5-8b27-25f9bbbec25b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-b3104592-20b1-4451-a3fd-9886035d3d58-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33 1073741824" returned: 0 in 0.580s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a1577403-34f0-4cd4-a9be-afce430752fe tempest-CreateVolumesFromImageTest-400258714 None] Lock "cinder-937d00e5-964c-4b2b-85f1-649ae11bae49-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f333367d-7772-42e0-a189-b7072581a568 tempest-VolumeImageDependencyTests-1217452040 None] Acquiring lock "cinder-quobyte-d49ca16f-8093-4f81-94a5-fa8e751d4501" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7c7249a8-22e1-4ae5-8b27-25f9bbbec25b tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-b3104592-20b1-4451-a3fd-9886035d3d58" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f333367d-7772-42e0-a189-b7072581a568 tempest-VolumeImageDependencyTests-1217452040 None] Lock "cinder-quobyte-d49ca16f-8093-4f81-94a5-fa8e751d4501" acquired by "delete_volume" :: waited 0.025s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7c7249a8-22e1-4ae5-8b27-25f9bbbec25b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-b3104592-20b1-4451-a3fd-9886035d3d58" acquired by "delete_volume" :: waited 0.036s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a35713-4fa4-4fdd-9bc9-052a40e15a3f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f333367d-7772-42e0-a189-b7072581a568 tempest-VolumeImageDependencyTests-1217452040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d49ca16f-8093-4f81-94a5-fa8e751d4501 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[b991afeb-6dab-450c-86de-46e6adc3a119]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7c7249a8-22e1-4ae5-8b27-25f9bbbec25b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:42 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33 Nov 06 18:51:42 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:42 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d49ca16f-8093-4f81-94a5-fa8e751d4501 Nov 06 18:51:42 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:42 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58 Nov 06 18:51:42 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:42 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33" returned: 0 in 0.274s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3dbdca-8aee-41d9-9f51-2e6d02fd4267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a984da78-43bb-4de0-a5da-83d141394f33', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25dd45a1-e77f-4471-a024-6c4d4106aede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:42 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Volume volume-a984da78-43bb-4de0-a5da-83d141394f33 (a984da78-43bb-4de0-a5da-83d141394f33): created successfully Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25dd45a1-e77f-4471-a024-6c4d4106aede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Flow 'volume_create_manager' (ec6fc364-6e56-4ab9-918a-073f7117fa1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:42 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a07a7b63-5a0c-4c2d-b298-7987e085bef8 tempest-CinderUnicodeTest-1985796729 None] Created volume successfully. Nov 06 18:51:42 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7c7249a8-22e1-4ae5-8b27-25f9bbbec25b tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58" returned: 0 in 0.444s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7c7249a8-22e1-4ae5-8b27-25f9bbbec25b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:42 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f333367d-7772-42e0-a189-b7072581a568 tempest-VolumeImageDependencyTests-1217452040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d49ca16f-8093-4f81-94a5-fa8e751d4501" returned: 0 in 0.491s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f333367d-7772-42e0-a189-b7072581a568 tempest-VolumeImageDependencyTests-1217452040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d49ca16f-8093-4f81-94a5-fa8e751d4501 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:42 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58 Nov 06 18:51:42 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:42 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d49ca16f-8093-4f81-94a5-fa8e751d4501 Nov 06 18:51:42 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:43 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7c7249a8-22e1-4ae5-8b27-25f9bbbec25b tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b3104592-20b1-4451-a3fd-9886035d3d58" returned: 0 in 0.274s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7c7249a8-22e1-4ae5-8b27-25f9bbbec25b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-b3104592-20b1-4451-a3fd-9886035d3d58" released by "delete_volume" :: held 0.791s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:43 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f333367d-7772-42e0-a189-b7072581a568 tempest-VolumeImageDependencyTests-1217452040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-d49ca16f-8093-4f81-94a5-fa8e751d4501" returned: 0 in 0.289s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f333367d-7772-42e0-a189-b7072581a568 tempest-VolumeImageDependencyTests-1217452040 None] Lock "cinder-quobyte-d49ca16f-8093-4f81-94a5-fa8e751d4501" released by "delete_volume" :: held 0.856s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-7c7249a8-22e1-4ae5-8b27-25f9bbbec25b tempest-ProjectMemberTests-1601559702 None] Created reservations ['ed468cf8-67fa-45f1-be70-d9b214d55474', 'fc3aaa06-a4c8-4984-bad8-15049d047f7a', '119d3290-7135-4ab1-9087-8057f6f4e020', 'cbacff68-8abf-4961-8ada-b290bc9c996e'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-f333367d-7772-42e0-a189-b7072581a568 tempest-VolumeImageDependencyTests-1217452040 None] Created reservations ['f9e3e9fb-c32f-4f4c-bf30-720730e6c8d1', '76c61e65-2742-4a74-9dcb-35b19784c9aa', 'fe23cb6f-7d20-4d99-8086-775011c1151c', 'e3bb8df6-60c9-4ba6-b56a-c8b576a4f78b'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7c7249a8-22e1-4ae5-8b27-25f9bbbec25b tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7c7249a8-22e1-4ae5-8b27-25f9bbbec25b tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7c7249a8-22e1-4ae5-8b27-25f9bbbec25b tempest-ProjectMemberTests-1601559702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7c7249a8-22e1-4ae5-8b27-25f9bbbec25b tempest-ProjectMemberTests-1601559702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7c7249a8-22e1-4ae5-8b27-25f9bbbec25b tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7c7249a8-22e1-4ae5-8b27-25f9bbbec25b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:43 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:43 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f333367d-7772-42e0-a189-b7072581a568 tempest-VolumeImageDependencyTests-1217452040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f333367d-7772-42e0-a189-b7072581a568 tempest-VolumeImageDependencyTests-1217452040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f333367d-7772-42e0-a189-b7072581a568 tempest-VolumeImageDependencyTests-1217452040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f333367d-7772-42e0-a189-b7072581a568 tempest-VolumeImageDependencyTests-1217452040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f333367d-7772-42e0-a189-b7072581a568 tempest-VolumeImageDependencyTests-1217452040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f333367d-7772-42e0-a189-b7072581a568 tempest-VolumeImageDependencyTests-1217452040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:43 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:43 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:43 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7c7249a8-22e1-4ae5-8b27-25f9bbbec25b tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.345s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-7c7249a8-22e1-4ae5-8b27-25f9bbbec25b tempest-ProjectMemberTests-1601559702 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:43 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-7c7249a8-22e1-4ae5-8b27-25f9bbbec25b tempest-ProjectMemberTests-1601559702 None] Deleted volume successfully. Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7c7249a8-22e1-4ae5-8b27-25f9bbbec25b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-b3104592-20b1-4451-a3fd-9886035d3d58-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:43 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f333367d-7772-42e0-a189-b7072581a568 tempest-VolumeImageDependencyTests-1217452040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.380s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-f333367d-7772-42e0-a189-b7072581a568 tempest-VolumeImageDependencyTests-1217452040 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:43 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-f333367d-7772-42e0-a189-b7072581a568 tempest-VolumeImageDependencyTests-1217452040 None] Deleted volume successfully. Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f333367d-7772-42e0-a189-b7072581a568 tempest-VolumeImageDependencyTests-1217452040 None] Lock "cinder-d49ca16f-8093-4f81-94a5-fa8e751d4501-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Flow 'volume_create_manager' (55d34d6d-9169-4a93-a92a-fd0597b5c67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2fe968-360d-41f3-90ac-218c60cbafb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2fe968-360d-41f3-90ac-218c60cbafb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1683259390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=428fd050-73f0-4026-b09d-8445efda2abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a2d825e4974b0aa6a265daab4682d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:44Z,use_quota=True,user_id='40d648cb4ea342798df1a2c960e9d938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e752fb-800b-4615-a17c-a59cb376f4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e752fb-800b-4615-a17c-a59cb376f4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192553eb-4170-406a-adae-c8cc3fc3983a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192553eb-4170-406a-adae-c8cc3fc3983a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '428fd050-73f0-4026-b09d-8445efda2abd', 'volume_name': 'volume-428fd050-73f0-4026-b09d-8445efda2abd', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dc2f51-7607-468d-b03e-76c67ec60694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dc2f51-7607-468d-b03e-76c67ec60694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408dcced-9347-4069-a917-38a0a3188fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:44 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Volume 428fd050-73f0-4026-b09d-8445efda2abd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-428fd050-73f0-4026-b09d-8445efda2abd', 'volume_size': 1} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1683259390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=428fd050-73f0-4026-b09d-8445efda2abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a2d825e4974b0aa6a265daab4682d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:44Z,use_quota=True,user_id='40d648cb4ea342798df1a2c960e9d938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Creating volume 428fd050-73f0-4026-b09d-8445efda2abd {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:44 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:44 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd 1073741824 Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1a391559-d78a-4eb3-a7be-628d8d0a64df tempest-CinderUnicodeTest-1985796729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:44 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:44 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd 1073741824" returned: 0 in 0.498s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:44 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd Nov 06 18:51:44 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:44 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd" returned: 0 in 0.304s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1a391559-d78a-4eb3-a7be-628d8d0a64df tempest-CinderUnicodeTest-1985796729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.817s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408dcced-9347-4069-a917-38a0a3188fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-428fd050-73f0-4026-b09d-8445efda2abd', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5f8eaf-9c2a-4658-a763-efb389637255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-1a391559-d78a-4eb3-a7be-628d8d0a64df tempest-CinderUnicodeTest-1985796729 None] Creating offline snapshot b5208101-8200-408a-8ed9-27dff088ca77 of volume a984da78-43bb-4de0-a5da-83d141394f33 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:51:44 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Volume volume-428fd050-73f0-4026-b09d-8445efda2abd (428fd050-73f0-4026-b09d-8445efda2abd): created successfully Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5f8eaf-9c2a-4658-a763-efb389637255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Flow 'volume_create_manager' (55d34d6d-9169-4a93-a92a-fd0597b5c67e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[082080d2-d2ef-460d-80c9-199ee38f33dd]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1a391559-d78a-4eb3-a7be-628d8d0a64df tempest-CinderUnicodeTest-1985796729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:44 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-4c99476d-73d0-4d62-9833-dced8c40689d tempest-ProjectMemberTests-1601559702 None] Created volume successfully. Nov 06 18:51:45 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33 Nov 06 18:51:45 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:45 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Flow 'volume_create_manager' (4fa0579f-9ed6-4530-be91-55e49ed88d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07db6bc7-3b4f-4d20-85ac-5f03938dba22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07db6bc7-3b4f-4d20-85ac-5f03938dba22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-652690899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca2e78f-46ad-48db-81df-c5cad8c901a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9152f36f8264da78cc98fda436a3460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:45Z,use_quota=True,user_id='1581a2f493c448d6a89305e3e3ec399f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9717b437-5abc-4976-85a0-5734c25a69b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9717b437-5abc-4976-85a0-5734c25a69b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:45 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96cdd2b-c194-4b3d-9fdf-eba6265361c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96cdd2b-c194-4b3d-9fdf-eba6265361c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bca2e78f-46ad-48db-81df-c5cad8c901a1', 'volume_name': 'volume-bca2e78f-46ad-48db-81df-c5cad8c901a1', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c747283-99d4-4980-96a0-943148b5b627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c747283-99d4-4980-96a0-943148b5b627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:45 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e69164-0bf0-4189-a913-336d6f7b2adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:45 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Volume bca2e78f-46ad-48db-81df-c5cad8c901a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bca2e78f-46ad-48db-81df-c5cad8c901a1', 'volume_size': 1} Nov 06 18:51:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1a391559-d78a-4eb3-a7be-628d8d0a64df tempest-CinderUnicodeTest-1985796729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33" returned: 0 in 0.435s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1a391559-d78a-4eb3-a7be-628d8d0a64df tempest-CinderUnicodeTest-1985796729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.b5208101-8200-408a-8ed9-27dff088ca77 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:45 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.b5208101-8200-408a-8ed9-27dff088ca77 1G Nov 06 18:51:45 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:45 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1a391559-d78a-4eb3-a7be-628d8d0a64df tempest-CinderUnicodeTest-1985796729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.b5208101-8200-408a-8ed9-27dff088ca77 1G" returned: 0 in 0.431s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1a391559-d78a-4eb3-a7be-628d8d0a64df tempest-CinderUnicodeTest-1985796729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a984da78-43bb-4de0-a5da-83d141394f33 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.b5208101-8200-408a-8ed9-27dff088ca77 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:45 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a984da78-43bb-4de0-a5da-83d141394f33 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.b5208101-8200-408a-8ed9-27dff088ca77 Nov 06 18:51:45 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:46 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1a391559-d78a-4eb3-a7be-628d8d0a64df tempest-CinderUnicodeTest-1985796729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a984da78-43bb-4de0-a5da-83d141394f33 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.b5208101-8200-408a-8ed9-27dff088ca77" returned: 0 in 0.361s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:46 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-1a391559-d78a-4eb3-a7be-628d8d0a64df tempest-CinderUnicodeTest-1985796729 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.b5208101-8200-408a-8ed9-27dff088ca77 is being set with open permissions: ugo+rw Nov 06 18:51:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1a391559-d78a-4eb3-a7be-628d8d0a64df tempest-CinderUnicodeTest-1985796729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.b5208101-8200-408a-8ed9-27dff088ca77 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:46 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.b5208101-8200-408a-8ed9-27dff088ca77 Nov 06 18:51:46 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-48a34f96-ecf7-4362-9043-3a12c0716a69 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:46 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1a391559-d78a-4eb3-a7be-628d8d0a64df tempest-CinderUnicodeTest-1985796729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.b5208101-8200-408a-8ed9-27dff088ca77" returned: 0 in 0.250s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1a391559-d78a-4eb3-a7be-628d8d0a64df tempest-CinderUnicodeTest-1985796729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:46 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.info Nov 06 18:51:46 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:46 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1a391559-d78a-4eb3-a7be-628d8d0a64df tempest-CinderUnicodeTest-1985796729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.info" returned: 0 in 0.257s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:46 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-1a391559-d78a-4eb3-a7be-628d8d0a64df tempest-CinderUnicodeTest-1985796729 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.info is being set with open permissions: ugo+rw Nov 06 18:51:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1a391559-d78a-4eb3-a7be-628d8d0a64df tempest-CinderUnicodeTest-1985796729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:46 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.info Nov 06 18:51:46 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:46 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-1a391559-d78a-4eb3-a7be-628d8d0a64df tempest-CinderUnicodeTest-1985796729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.info" returned: 0 in 0.253s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-1a391559-d78a-4eb3-a7be-628d8d0a64df tempest-CinderUnicodeTest-1985796729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.120s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.614s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-652690899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca2e78f-46ad-48db-81df-c5cad8c901a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9152f36f8264da78cc98fda436a3460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:45Z,use_quota=True,user_id='1581a2f493c448d6a89305e3e3ec399f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Creating volume bca2e78f-46ad-48db-81df-c5cad8c901a1 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:47 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:47 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 1073741824 Nov 06 18:51:47 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:47 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-1a391559-d78a-4eb3-a7be-628d8d0a64df tempest-CinderUnicodeTest-1985796729 None] Create snapshot completed successfully Nov 06 18:51:47 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 1073741824" returned: 0 in 0.456s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:47 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 Nov 06 18:51:47 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:47 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1" returned: 0 in 0.244s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-48a34f96-ecf7-4362-9043-3a12c0716a69 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.533s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-48a34f96-ecf7-4362-9043-3a12c0716a69 tempest-ProjectMemberTests-1601559702 None] Creating offline snapshot 249d7e49-47dd-4aa1-abd2-4aff65a92e19 of volume 428fd050-73f0-4026-b09d-8445efda2abd {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e69164-0bf0-4189-a913-336d6f7b2adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca2e78f-46ad-48db-81df-c5cad8c901a1', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1b69f7-3433-43cc-b4ed-34fa87182501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[53426e1c-f543-4c30-9ec9-5b0f711cbe0f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-48a34f96-ecf7-4362-9043-3a12c0716a69 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:47 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Volume volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 (bca2e78f-46ad-48db-81df-c5cad8c901a1): created successfully Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1b69f7-3433-43cc-b4ed-34fa87182501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:47 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Flow 'volume_create_manager' (4fa0579f-9ed6-4530-be91-55e49ed88d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:47 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-4de9f029-5022-4868-9981-b755d0b7304e tempest-VolumeDependencyTests-1339900225 None] Created volume successfully. Nov 06 18:51:47 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd Nov 06 18:51:47 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:48 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-48a34f96-ecf7-4362-9043-3a12c0716a69 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd" returned: 0 in 0.393s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-48a34f96-ecf7-4362-9043-3a12c0716a69 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.249d7e49-47dd-4aa1-abd2-4aff65a92e19 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] Acquiring lock "cinder-b5208101-8200-408a-8ed9-27dff088ca77-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:48 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.249d7e49-47dd-4aa1-abd2-4aff65a92e19 1G Nov 06 18:51:48 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] Lock "cinder-b5208101-8200-408a-8ed9-27dff088ca77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] Acquiring lock "cinder-quobyte-a984da78-43bb-4de0-a5da-83d141394f33" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] Lock "cinder-quobyte-a984da78-43bb-4de0-a5da-83d141394f33" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] Acquiring lock "cinder-quobyte-b5208101-8200-408a-8ed9-27dff088ca77" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:48 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] Lock "cinder-quobyte-b5208101-8200-408a-8ed9-27dff088ca77" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] Deleting offline snapshot b5208101-8200-408a-8ed9-27dff088ca77 of volume a984da78-43bb-4de0-a5da-83d141394f33 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:51:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] snapshot_file for this snap is: volume-a984da78-43bb-4de0-a5da-83d141394f33.b5208101-8200-408a-8ed9-27dff088ca77 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:51:48 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[4096c570-9228-4e66-8e67-149172e067ff]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.b5208101-8200-408a-8ed9-27dff088ca77 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:48 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.b5208101-8200-408a-8ed9-27dff088ca77 Nov 06 18:51:48 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6d6893e6-7ccb-4675-9652-4bcc74434392 tempest-VolumeDependencyTests-1339900225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:48 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-48a34f96-ecf7-4362-9043-3a12c0716a69 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.249d7e49-47dd-4aa1-abd2-4aff65a92e19 1G" returned: 0 in 0.610s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-48a34f96-ecf7-4362-9043-3a12c0716a69 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-428fd050-73f0-4026-b09d-8445efda2abd -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.249d7e49-47dd-4aa1-abd2-4aff65a92e19 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:48 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.b5208101-8200-408a-8ed9-27dff088ca77" returned: 0 in 0.502s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a984da78-43bb-4de0-a5da-83d141394f33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:51:48 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-428fd050-73f0-4026-b09d-8445efda2abd -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.249d7e49-47dd-4aa1-abd2-4aff65a92e19 Nov 06 18:51:48 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:48 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[1715903c-e08d-4898-a737-06a8908d32e6]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:49 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33 Nov 06 18:51:49 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:49 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-48a34f96-ecf7-4362-9043-3a12c0716a69 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-428fd050-73f0-4026-b09d-8445efda2abd -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.249d7e49-47dd-4aa1-abd2-4aff65a92e19" returned: 0 in 0.334s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:49 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-48a34f96-ecf7-4362-9043-3a12c0716a69 tempest-ProjectMemberTests-1601559702 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.249d7e49-47dd-4aa1-abd2-4aff65a92e19 is being set with open permissions: ugo+rw Nov 06 18:51:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-48a34f96-ecf7-4362-9043-3a12c0716a69 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.249d7e49-47dd-4aa1-abd2-4aff65a92e19 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:49 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.249d7e49-47dd-4aa1-abd2-4aff65a92e19 Nov 06 18:51:49 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:49 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33" returned: 0 in 0.399s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.b5208101-8200-408a-8ed9-27dff088ca77 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:49 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.b5208101-8200-408a-8ed9-27dff088ca77 Nov 06 18:51:49 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:49 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-48a34f96-ecf7-4362-9043-3a12c0716a69 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.249d7e49-47dd-4aa1-abd2-4aff65a92e19" returned: 0 in 0.289s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-48a34f96-ecf7-4362-9043-3a12c0716a69 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:49 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.info Nov 06 18:51:49 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:49 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.b5208101-8200-408a-8ed9-27dff088ca77" returned: 0 in 0.418s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.b5208101-8200-408a-8ed9-27dff088ca77 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:49 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.b5208101-8200-408a-8ed9-27dff088ca77 Nov 06 18:51:49 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:49 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-48a34f96-ecf7-4362-9043-3a12c0716a69 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.info" returned: 0 in 0.309s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:49 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-48a34f96-ecf7-4362-9043-3a12c0716a69 tempest-ProjectMemberTests-1601559702 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.info is being set with open permissions: ugo+rw Nov 06 18:51:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-48a34f96-ecf7-4362-9043-3a12c0716a69 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:49 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.info Nov 06 18:51:49 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:50 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33.b5208101-8200-408a-8ed9-27dff088ca77" returned: 0 in 0.303s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:50 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-48a34f96-ecf7-4362-9043-3a12c0716a69 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.info" returned: 0 in 0.266s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-48a34f96-ecf7-4362-9043-3a12c0716a69 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.315s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] Lock "cinder-quobyte-b5208101-8200-408a-8ed9-27dff088ca77" released by "_delete_snapshot" :: held 1.797s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6d6893e6-7ccb-4675-9652-4bcc74434392 tempest-VolumeDependencyTests-1339900225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.374s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-6d6893e6-7ccb-4675-9652-4bcc74434392 tempest-VolumeDependencyTests-1339900225 None] Creating offline snapshot 46e26897-8272-4730-b291-476ddf6d0a6c of volume bca2e78f-46ad-48db-81df-c5cad8c901a1 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] Lock "cinder-quobyte-a984da78-43bb-4de0-a5da-83d141394f33" released by "delete_snapshot" :: held 1.852s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2022df-a5a4-43c8-b826-395f0a9c4b9f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d6893e6-7ccb-4675-9652-4bcc74434392 tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:50 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-48a34f96-ecf7-4362-9043-3a12c0716a69 tempest-ProjectMemberTests-1601559702 None] Create snapshot completed successfully Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] Created reservations ['a30ae4ec-7d59-413e-9d73-7d84de68442a', '316a40d5-f662-45ee-9cbf-aebdcf8e6871', '87f391ce-4c92-4b4b-84e2-9bb3a0f8264c', 'cb2f97fe-5e62-4b5f-8c9c-80c52977e2ac'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:50 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 Nov 06 18:51:50 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:50 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] Delete snapshot completed successfully. Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-8a8c48e3-ccf4-4cfc-80a4-1aeb8ea524ff tempest-CinderUnicodeTest-1985796729 None] Lock "cinder-b5208101-8200-408a-8ed9-27dff088ca77-delete_snapshot" released by "delete_snapshot" :: held 2.142s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-249d7e49-47dd-4aa1-abd2-4aff65a92e19-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a6d114b9-1106-4a86-805c-a76e198eb4c8 tempest-CinderUnicodeTest-1985796729 None] Acquiring lock "cinder-a984da78-43bb-4de0-a5da-83d141394f33-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-249d7e49-47dd-4aa1-abd2-4aff65a92e19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-428fd050-73f0-4026-b09d-8445efda2abd" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a6d114b9-1106-4a86-805c-a76e198eb4c8 tempest-CinderUnicodeTest-1985796729 None] Lock "cinder-a984da78-43bb-4de0-a5da-83d141394f33-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-428fd050-73f0-4026-b09d-8445efda2abd" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-249d7e49-47dd-4aa1-abd2-4aff65a92e19" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-249d7e49-47dd-4aa1-abd2-4aff65a92e19" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] Deleting offline snapshot 249d7e49-47dd-4aa1-abd2-4aff65a92e19 of volume 428fd050-73f0-4026-b09d-8445efda2abd {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] snapshot_file for this snap is: volume-428fd050-73f0-4026-b09d-8445efda2abd.249d7e49-47dd-4aa1-abd2-4aff65a92e19 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a6d114b9-1106-4a86-805c-a76e198eb4c8 tempest-CinderUnicodeTest-1985796729 None] Acquiring lock "cinder-quobyte-a984da78-43bb-4de0-a5da-83d141394f33" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[930ae2ea-ee9f-4dc1-98e1-b8b5ac4b42e0]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.249d7e49-47dd-4aa1-abd2-4aff65a92e19 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a6d114b9-1106-4a86-805c-a76e198eb4c8 tempest-CinderUnicodeTest-1985796729 None] Lock "cinder-quobyte-a984da78-43bb-4de0-a5da-83d141394f33" acquired by "delete_volume" :: waited 0.031s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[82df8e78-8cad-4327-8909-3426b16706c5]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a6d114b9-1106-4a86-805c-a76e198eb4c8 tempest-CinderUnicodeTest-1985796729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:50 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d6893e6-7ccb-4675-9652-4bcc74434392 tempest-VolumeDependencyTests-1339900225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1" returned: 0 in 0.616s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d6893e6-7ccb-4675-9652-4bcc74434392 tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:50 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c 1G Nov 06 18:51:50 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:50 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.249d7e49-47dd-4aa1-abd2-4aff65a92e19 Nov 06 18:51:50 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:50 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33 Nov 06 18:51:50 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:51 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.249d7e49-47dd-4aa1-abd2-4aff65a92e19" returned: 0 in 0.491s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-428fd050-73f0-4026-b09d-8445efda2abd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[87879008-c78e-457f-b94d-b08c3ead524f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:51 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a6d114b9-1106-4a86-805c-a76e198eb4c8 tempest-CinderUnicodeTest-1985796729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33" returned: 0 in 0.465s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a6d114b9-1106-4a86-805c-a76e198eb4c8 tempest-CinderUnicodeTest-1985796729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:51 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33 Nov 06 18:51:51 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:51 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:51 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd Nov 06 18:51:51 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d6893e6-7ccb-4675-9652-4bcc74434392 tempest-VolumeDependencyTests-1339900225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c 1G" returned: 0 in 0.537s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d6893e6-7ccb-4675-9652-4bcc74434392 tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:51 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c Nov 06 18:51:51 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:51 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a6d114b9-1106-4a86-805c-a76e198eb4c8 tempest-CinderUnicodeTest-1985796729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a984da78-43bb-4de0-a5da-83d141394f33" returned: 0 in 0.286s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a6d114b9-1106-4a86-805c-a76e198eb4c8 tempest-CinderUnicodeTest-1985796729 None] Lock "cinder-quobyte-a984da78-43bb-4de0-a5da-83d141394f33" released by "delete_volume" :: held 0.840s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-a6d114b9-1106-4a86-805c-a76e198eb4c8 tempest-CinderUnicodeTest-1985796729 None] Created reservations ['edf67408-78e7-4483-94c8-debe5c29490a', 'ea3d5cda-ada5-4044-ade6-8c4f6adb817f', '3d6c7282-9f32-47bb-9ccf-a46c14f70611', '2b903f06-d11b-49bf-a3b4-85b35ecf9e22'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:51 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd" returned: 0 in 0.465s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.249d7e49-47dd-4aa1-abd2-4aff65a92e19 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:51 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.249d7e49-47dd-4aa1-abd2-4aff65a92e19 Nov 06 18:51:51 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:51 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d6893e6-7ccb-4675-9652-4bcc74434392 tempest-VolumeDependencyTests-1339900225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c" returned: 0 in 0.414s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:51 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-6d6893e6-7ccb-4675-9652-4bcc74434392 tempest-VolumeDependencyTests-1339900225 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c is being set with open permissions: ugo+rw Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d6893e6-7ccb-4675-9652-4bcc74434392 tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a6d114b9-1106-4a86-805c-a76e198eb4c8 tempest-CinderUnicodeTest-1985796729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a6d114b9-1106-4a86-805c-a76e198eb4c8 tempest-CinderUnicodeTest-1985796729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a6d114b9-1106-4a86-805c-a76e198eb4c8 tempest-CinderUnicodeTest-1985796729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a6d114b9-1106-4a86-805c-a76e198eb4c8 tempest-CinderUnicodeTest-1985796729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a6d114b9-1106-4a86-805c-a76e198eb4c8 tempest-CinderUnicodeTest-1985796729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a6d114b9-1106-4a86-805c-a76e198eb4c8 tempest-CinderUnicodeTest-1985796729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:51 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c Nov 06 18:51:51 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:51 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:51 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:52 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d6893e6-7ccb-4675-9652-4bcc74434392 tempest-VolumeDependencyTests-1339900225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c" returned: 0 in 0.292s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:52 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d6893e6-7ccb-4675-9652-4bcc74434392 tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.249d7e49-47dd-4aa1-abd2-4aff65a92e19" returned: 0 in 0.419s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.249d7e49-47dd-4aa1-abd2-4aff65a92e19 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:52 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a6d114b9-1106-4a86-805c-a76e198eb4c8 tempest-CinderUnicodeTest-1985796729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.326s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-a6d114b9-1106-4a86-805c-a76e198eb4c8 tempest-CinderUnicodeTest-1985796729 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:52 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.info Nov 06 18:51:52 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:52 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a6d114b9-1106-4a86-805c-a76e198eb4c8 tempest-CinderUnicodeTest-1985796729 None] Deleted volume successfully. Nov 06 18:51:52 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.249d7e49-47dd-4aa1-abd2-4aff65a92e19 Nov 06 18:51:52 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a6d114b9-1106-4a86-805c-a76e198eb4c8 tempest-CinderUnicodeTest-1985796729 None] Lock "cinder-a984da78-43bb-4de0-a5da-83d141394f33-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:52 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:52 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd.249d7e49-47dd-4aa1-abd2-4aff65a92e19" returned: 0 in 0.282s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d6893e6-7ccb-4675-9652-4bcc74434392 tempest-VolumeDependencyTests-1339900225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.info" returned: 0 in 0.323s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:52 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-6d6893e6-7ccb-4675-9652-4bcc74434392 tempest-VolumeDependencyTests-1339900225 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.info is being set with open permissions: ugo+rw Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d6893e6-7ccb-4675-9652-4bcc74434392 tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-249d7e49-47dd-4aa1-abd2-4aff65a92e19" released by "_delete_snapshot" :: held 1.800s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-428fd050-73f0-4026-b09d-8445efda2abd" released by "delete_snapshot" :: held 1.844s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:52 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.info Nov 06 18:51:52 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] Created reservations ['4e504ffc-d657-43b0-b77d-4e7066d904a8', '2a4a17ee-a862-459f-922a-c8fabfe1bf59', 'bc002723-736c-47ff-9170-7b6de3c44f27', '0c0f3eb6-b9fc-4cdc-95b1-8a7e3a03df49'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:52 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] Delete snapshot completed successfully. Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e7bcf39d-a0ee-46b5-989e-2d597d527297 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-249d7e49-47dd-4aa1-abd2-4aff65a92e19-delete_snapshot" released by "delete_snapshot" :: held 2.076s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:52 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6d6893e6-7ccb-4675-9652-4bcc74434392 tempest-VolumeDependencyTests-1339900225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.info" returned: 0 in 0.309s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6d6893e6-7ccb-4675-9652-4bcc74434392 tempest-VolumeDependencyTests-1339900225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.647s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e103c84a-196b-4f51-a100-7f4c5d289b86 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-428fd050-73f0-4026-b09d-8445efda2abd-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e103c84a-196b-4f51-a100-7f4c5d289b86 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-428fd050-73f0-4026-b09d-8445efda2abd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:52 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-6d6893e6-7ccb-4675-9652-4bcc74434392 tempest-VolumeDependencyTests-1339900225 None] Create snapshot completed successfully Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e103c84a-196b-4f51-a100-7f4c5d289b86 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-428fd050-73f0-4026-b09d-8445efda2abd" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e103c84a-196b-4f51-a100-7f4c5d289b86 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-428fd050-73f0-4026-b09d-8445efda2abd" acquired by "delete_volume" :: waited 0.024s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-dbd0a8cc-de35-4eb8-83bc-38d4ba2ae31b tempest-CinderUnicodeTest-1985796729 None] Acquiring lock "cinder-0065bed2-c956-42c5-80e5-035e70824c56-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-dbd0a8cc-de35-4eb8-83bc-38d4ba2ae31b tempest-CinderUnicodeTest-1985796729 None] Lock "cinder-0065bed2-c956-42c5-80e5-035e70824c56-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a4f25d-a151-4c77-ad02-08a9228fd6d3]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e103c84a-196b-4f51-a100-7f4c5d289b86 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-dbd0a8cc-de35-4eb8-83bc-38d4ba2ae31b tempest-CinderUnicodeTest-1985796729 None] Acquiring lock "cinder-quobyte-0065bed2-c956-42c5-80e5-035e70824c56" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-dbd0a8cc-de35-4eb8-83bc-38d4ba2ae31b tempest-CinderUnicodeTest-1985796729 None] Lock "cinder-quobyte-0065bed2-c956-42c5-80e5-035e70824c56" acquired by "delete_volume" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1eb1c0-db7f-4248-8284-29a246720184]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbd0a8cc-de35-4eb8-83bc-38d4ba2ae31b tempest-CinderUnicodeTest-1985796729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0065bed2-c956-42c5-80e5-035e70824c56 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:53 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd Nov 06 18:51:53 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:53 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0065bed2-c956-42c5-80e5-035e70824c56 Nov 06 18:51:53 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:53 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e103c84a-196b-4f51-a100-7f4c5d289b86 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd" returned: 0 in 0.562s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e103c84a-196b-4f51-a100-7f4c5d289b86 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:53 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd Nov 06 18:51:53 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:53 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbd0a8cc-de35-4eb8-83bc-38d4ba2ae31b tempest-CinderUnicodeTest-1985796729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0065bed2-c956-42c5-80e5-035e70824c56" returned: 0 in 0.557s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbd0a8cc-de35-4eb8-83bc-38d4ba2ae31b tempest-CinderUnicodeTest-1985796729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0065bed2-c956-42c5-80e5-035e70824c56 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:53 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0065bed2-c956-42c5-80e5-035e70824c56 Nov 06 18:51:53 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Flow 'volume_create_manager' (21570197-7e16-48ed-ae63-8f68e00eba32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d05d76-3df9-4a08-8cea-1ec1f5a6e594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d05d76-3df9-4a08-8cea-1ec1f5a6e594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-464015859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e72e02c-b3fe-485a-890a-ffc93d493579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9152f36f8264da78cc98fda436a3460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=46e26897-8272-4730-b291-476ddf6d0a6c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:53Z,use_quota=True,user_id='1581a2f493c448d6a89305e3e3ec399f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dbad160-e9c9-4916-832d-21597dff4747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dbad160-e9c9-4916-832d-21597dff4747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c70a1dd-47ac-422a-8317-2c20e8ad7f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c70a1dd-47ac-422a-8317-2c20e8ad7f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1e72e02c-b3fe-485a-890a-ffc93d493579', 'volume_name': 'volume-1e72e02c-b3fe-485a-890a-ffc93d493579', 'volume_size': 1, 'snapshot_id': '46e26897-8272-4730-b291-476ddf6d0a6c'}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17daf95-2227-4c46-be6e-0b30934a4cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17daf95-2227-4c46-be6e-0b30934a4cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0d713a-8570-483d-ab15-203484c78683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:53 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Volume 1e72e02c-b3fe-485a-890a-ffc93d493579: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1e72e02c-b3fe-485a-890a-ffc93d493579', 'volume_size': 1, 'snapshot_id': '46e26897-8272-4730-b291-476ddf6d0a6c'} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Acquiring lock "cinder-quobyte-46e26897-8272-4730-b291-476ddf6d0a6c-1e72e02c-b3fe-485a-890a-ffc93d493579" by "_create_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Lock "cinder-quobyte-46e26897-8272-4730-b291-476ddf6d0a6c-1e72e02c-b3fe-485a-890a-ffc93d493579" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Creating volume 1e72e02c-b3fe-485a-890a-ffc93d493579 from snapshot 46e26897-8272-4730-b291-476ddf6d0a6c {{(pid=86794) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Acquiring lock "cinder-quobyte-1e72e02c-b3fe-485a-890a-ffc93d493579" by "_copy_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Lock "cinder-quobyte-1e72e02c-b3fe-485a-890a-ffc93d493579" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] snapshot: 46e26897-8272-4730-b291-476ddf6d0a6c, volume: 1e72e02c-b3fe-485a-890a-ffc93d493579, {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ffa7be-af52-48a6-ab43-c6248c8f2b1a]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:53 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:53 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e103c84a-196b-4f51-a100-7f4c5d289b86 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-428fd050-73f0-4026-b09d-8445efda2abd" returned: 0 in 0.463s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbd0a8cc-de35-4eb8-83bc-38d4ba2ae31b tempest-CinderUnicodeTest-1985796729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0065bed2-c956-42c5-80e5-035e70824c56" returned: 0 in 0.365s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e103c84a-196b-4f51-a100-7f4c5d289b86 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-428fd050-73f0-4026-b09d-8445efda2abd" released by "delete_volume" :: held 1.166s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-dbd0a8cc-de35-4eb8-83bc-38d4ba2ae31b tempest-CinderUnicodeTest-1985796729 None] Lock "cinder-quobyte-0065bed2-c956-42c5-80e5-035e70824c56" released by "delete_volume" :: held 1.012s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-e103c84a-196b-4f51-a100-7f4c5d289b86 tempest-ProjectMemberTests-1601559702 None] Created reservations ['5fdd9349-5d99-4cfe-85c1-5d5709a9258e', '4be71092-beb4-45c6-9d33-11a73e440e0d', '2c42d90e-9ab5-4ece-9112-4fa34287921e', '801cb7d2-e171-4d2b-aa66-a1910c9f9c1b'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:54 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c Nov 06 18:51:54 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-dbd0a8cc-de35-4eb8-83bc-38d4ba2ae31b tempest-CinderUnicodeTest-1985796729 None] Created reservations ['31764891-d991-4e68-aff5-9ef1585cb3c0', '847824f0-4fbd-433a-9c21-b1b94180098b', '7e01deb1-c80c-4b3e-a3df-da40f9685767', '5469976d-6cc7-4311-ae7d-b1fa6ab38f2f'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e103c84a-196b-4f51-a100-7f4c5d289b86 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e103c84a-196b-4f51-a100-7f4c5d289b86 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e103c84a-196b-4f51-a100-7f4c5d289b86 tempest-ProjectMemberTests-1601559702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e103c84a-196b-4f51-a100-7f4c5d289b86 tempest-ProjectMemberTests-1601559702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e103c84a-196b-4f51-a100-7f4c5d289b86 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e103c84a-196b-4f51-a100-7f4c5d289b86 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:54 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:54 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dbd0a8cc-de35-4eb8-83bc-38d4ba2ae31b tempest-CinderUnicodeTest-1985796729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dbd0a8cc-de35-4eb8-83bc-38d4ba2ae31b tempest-CinderUnicodeTest-1985796729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-dbd0a8cc-de35-4eb8-83bc-38d4ba2ae31b tempest-CinderUnicodeTest-1985796729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-dbd0a8cc-de35-4eb8-83bc-38d4ba2ae31b tempest-CinderUnicodeTest-1985796729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dbd0a8cc-de35-4eb8-83bc-38d4ba2ae31b tempest-CinderUnicodeTest-1985796729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbd0a8cc-de35-4eb8-83bc-38d4ba2ae31b tempest-CinderUnicodeTest-1985796729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:54 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:51:54 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:54 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c" returned: 0 in 0.465s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bca2e78f-46ad-48db-81df-c5cad8c901a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[877926ef-1537-4095-9a04-96aeea870bc0]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:54 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e103c84a-196b-4f51-a100-7f4c5d289b86 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.326s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-e103c84a-196b-4f51-a100-7f4c5d289b86 tempest-ProjectMemberTests-1601559702 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:54 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-e103c84a-196b-4f51-a100-7f4c5d289b86 tempest-ProjectMemberTests-1601559702 None] Deleted volume successfully. Nov 06 18:51:54 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbd0a8cc-de35-4eb8-83bc-38d4ba2ae31b tempest-CinderUnicodeTest-1985796729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.326s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-dbd0a8cc-de35-4eb8-83bc-38d4ba2ae31b tempest-CinderUnicodeTest-1985796729 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:51:54 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-dbd0a8cc-de35-4eb8-83bc-38d4ba2ae31b tempest-CinderUnicodeTest-1985796729 None] Deleted volume successfully. Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e103c84a-196b-4f51-a100-7f4c5d289b86 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-428fd050-73f0-4026-b09d-8445efda2abd-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-dbd0a8cc-de35-4eb8-83bc-38d4ba2ae31b tempest-CinderUnicodeTest-1985796729 None] Lock "cinder-0065bed2-c956-42c5-80e5-035e70824c56-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:51:54 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 Nov 06 18:51:54 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:54 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1" returned: 0 in 0.449s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Creating direct copy from snapshot {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG cinder.utils [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Path /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1e72e02c-b3fe-485a-890a-ffc93d493579 not found in is_blk_device check {{(pid=86794) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 18:51:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1e72e02c-b3fe-485a-890a-ffc93d493579 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:51:54 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1e72e02c-b3fe-485a-890a-ffc93d493579 Nov 06 18:51:54 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:51:55 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:51:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Flow 'volume_create_manager' (9a0307ab-a252-4cda-bf40-31c2bd37a937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:51:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4a4f71-de07-4fad-afad-3393261100aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4a4f71-de07-4fad-afad-3393261100aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1970844853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0746872d-30f3-40e3-8df0-a9c7053ca70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a2d825e4974b0aa6a265daab4682d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:56Z,use_quota=True,user_id='40d648cb4ea342798df1a2c960e9d938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b48c168-f741-4961-b7ae-267933fb9c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b48c168-f741-4961-b7ae-267933fb9c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed2a9c01-7f2a-40ba-bba8-ea3407b991d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed2a9c01-7f2a-40ba-bba8-ea3407b991d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0746872d-30f3-40e3-8df0-a9c7053ca70f', 'volume_name': 'volume-0746872d-30f3-40e3-8df0-a9c7053ca70f', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94dbe27b-6e8a-470a-8b03-4dddec02874b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94dbe27b-6e8a-470a-8b03-4dddec02874b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:51:55 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d177040-17a3-4863-8967-fb048bdf8021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:51:55 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Volume 0746872d-30f3-40e3-8df0-a9c7053ca70f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0746872d-30f3-40e3-8df0-a9c7053ca70f', 'volume_size': 1} Nov 06 18:51:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:03 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1e72e02c-b3fe-485a-890a-ffc93d493579" returned: 0 in 8.443s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1, size 1024.00 MB, duration 8.44 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1e72e02c-b3fe-485a-890a-ffc93d493579 {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:52:03 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Converted 1024.00 MB image at 121.27 MB/s Nov 06 18:52:03 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1e72e02c-b3fe-485a-890a-ffc93d493579 is being set with open permissions: ugo+rw Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1e72e02c-b3fe-485a-890a-ffc93d493579 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:03 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1e72e02c-b3fe-485a-890a-ffc93d493579 Nov 06 18:52:03 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:03 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1e72e02c-b3fe-485a-890a-ffc93d493579" returned: 0 in 0.326s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Lock "cinder-quobyte-1e72e02c-b3fe-485a-890a-ffc93d493579" released by "_copy_volume_from_snapshot" :: held 9.821s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=242,cinder:UPDATE=292,cinder:INSERT=77,cinder:DELETE=34 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:UPDATE=324,cinder:SELECT=219,cinder:INSERT=89,cinder:DELETE=21 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Lock "cinder-quobyte-46e26897-8272-4730-b291-476ddf6d0a6c-1e72e02c-b3fe-485a-890a-ffc93d493579" released by "_create_volume_from_snapshot" :: held 9.916s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.940s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.839s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1970844853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0746872d-30f3-40e3-8df0-a9c7053ca70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a2d825e4974b0aa6a265daab4682d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:51:56Z,use_quota=True,user_id='40d648cb4ea342798df1a2c960e9d938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Creating volume 0746872d-30f3-40e3-8df0-a9c7053ca70f {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:52:03 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:03 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f 1073741824 Nov 06 18:52:03 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0d713a-8570-483d-ab15-203484c78683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e72e02c-b3fe-485a-890a-ffc93d493579', 'volume_size': 1, 'snapshot_id': '46e26897-8272-4730-b291-476ddf6d0a6c'}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e6f8df-39c8-4293-80e1-d39ff52e926b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:03 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Volume volume-1e72e02c-b3fe-485a-890a-ffc93d493579 (1e72e02c-b3fe-485a-890a-ffc93d493579): created successfully Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e6f8df-39c8-4293-80e1-d39ff52e926b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:03 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Flow 'volume_create_manager' (21570197-7e16-48ed-ae63-8f68e00eba32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:52:03 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-19ebcc12-a21a-4346-81b1-ec11cc296d64 tempest-VolumeDependencyTests-1339900225 None] Created volume successfully. Nov 06 18:52:04 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f 1073741824" returned: 0 in 0.583s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:04 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f Nov 06 18:52:04 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:04 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] Acquiring lock "cinder-46e26897-8272-4730-b291-476ddf6d0a6c-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:04 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] Lock "cinder-46e26897-8272-4730-b291-476ddf6d0a6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:04 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] Acquiring lock "cinder-quobyte-bca2e78f-46ad-48db-81df-c5cad8c901a1" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:04 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] Lock "cinder-quobyte-bca2e78f-46ad-48db-81df-c5cad8c901a1" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:04 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] Acquiring lock "cinder-quobyte-46e26897-8272-4730-b291-476ddf6d0a6c" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:04 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] Lock "cinder-quobyte-46e26897-8272-4730-b291-476ddf6d0a6c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] Deleting offline snapshot 46e26897-8272-4730-b291-476ddf6d0a6c of volume bca2e78f-46ad-48db-81df-c5cad8c901a1 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:52:04 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] snapshot_file for this snap is: volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:52:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f" returned: 0 in 0.515s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:52:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:04 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2016ad-d23f-419e-b8af-c4049bebaad2]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d177040-17a3-4863-8967-fb048bdf8021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0746872d-30f3-40e3-8df0-a9c7053ca70f', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:04 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae6b191-8813-49fd-aca7-dbf4175134b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:05 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Volume volume-0746872d-30f3-40e3-8df0-a9c7053ca70f (0746872d-30f3-40e3-8df0-a9c7053ca70f): created successfully Nov 06 18:52:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae6b191-8813-49fd-aca7-dbf4175134b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:05 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Flow 'volume_create_manager' (9a0307ab-a252-4cda-bf40-31c2bd37a937) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:52:05 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-e7e8ea4a-c265-4a6a-b005-16e152d1a6ad tempest-ProjectMemberTests-1601559702 None] Created volume successfully. Nov 06 18:52:05 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c Nov 06 18:52:05 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:05 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c" returned: 0 in 0.472s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bca2e78f-46ad-48db-81df-c5cad8c901a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:52:05 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24357bd-71b7-485a-a8c5-b6b43922436b]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:05 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 Nov 06 18:52:05 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ab069977-8ccc-4feb-b7b0-edd5ed01f3b2 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ab069977-8ccc-4feb-b7b0-edd5ed01f3b2 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:05 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-ab069977-8ccc-4feb-b7b0-edd5ed01f3b2 tempest-ProjectMemberTests-1601559702 None] Creating offline snapshot 36df50b9-95a1-4412-841b-3cf5d08deb10 of volume 0746872d-30f3-40e3-8df0-a9c7053ca70f {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:52:05 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d6117d-0ccc-4129-93d5-a9973ebf3333]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab069977-8ccc-4feb-b7b0-edd5ed01f3b2 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:05 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f Nov 06 18:52:05 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:06 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1" returned: 0 in 0.655s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:06 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c Nov 06 18:52:06 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:06 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab069977-8ccc-4feb-b7b0-edd5ed01f3b2 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f" returned: 0 in 0.387s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab069977-8ccc-4feb-b7b0-edd5ed01f3b2 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.36df50b9-95a1-4412-841b-3cf5d08deb10 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:06 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.36df50b9-95a1-4412-841b-3cf5d08deb10 1G Nov 06 18:52:06 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:06 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c" returned: 0 in 0.379s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:06 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c Nov 06 18:52:06 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:06 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab069977-8ccc-4feb-b7b0-edd5ed01f3b2 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.36df50b9-95a1-4412-841b-3cf5d08deb10 1G" returned: 0 in 0.491s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab069977-8ccc-4feb-b7b0-edd5ed01f3b2 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0746872d-30f3-40e3-8df0-a9c7053ca70f -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.36df50b9-95a1-4412-841b-3cf5d08deb10 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:06 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0746872d-30f3-40e3-8df0-a9c7053ca70f -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.36df50b9-95a1-4412-841b-3cf5d08deb10 Nov 06 18:52:06 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:06 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1.46e26897-8272-4730-b291-476ddf6d0a6c" returned: 0 in 0.319s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] Lock "cinder-quobyte-46e26897-8272-4730-b291-476ddf6d0a6c" released by "_delete_snapshot" :: held 1.996s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] Lock "cinder-quobyte-bca2e78f-46ad-48db-81df-c5cad8c901a1" released by "delete_snapshot" :: held 2.031s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:06 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] Created reservations ['11398cbd-2505-487e-b4c8-7d6f0372f159', 'ebc8fce8-ee35-4c04-965a-00c390599312', 'fa981fec-6cf1-46ec-a366-aa7a24595ce3', '919dc9a6-2a61-443f-9781-96abe0d68ff1'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:52:07 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] Delete snapshot completed successfully. Nov 06 18:52:07 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a2b5dab3-db4e-46ef-a31a-0f3f9fcce811 tempest-VolumeDependencyTests-1339900225 None] Lock "cinder-46e26897-8272-4730-b291-476ddf6d0a6c-delete_snapshot" released by "delete_snapshot" :: held 2.218s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:07 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab069977-8ccc-4feb-b7b0-edd5ed01f3b2 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0746872d-30f3-40e3-8df0-a9c7053ca70f -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.36df50b9-95a1-4412-841b-3cf5d08deb10" returned: 0 in 0.409s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:07 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-ab069977-8ccc-4feb-b7b0-edd5ed01f3b2 tempest-ProjectMemberTests-1601559702 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.36df50b9-95a1-4412-841b-3cf5d08deb10 is being set with open permissions: ugo+rw Nov 06 18:52:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab069977-8ccc-4feb-b7b0-edd5ed01f3b2 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.36df50b9-95a1-4412-841b-3cf5d08deb10 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:07 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.36df50b9-95a1-4412-841b-3cf5d08deb10 Nov 06 18:52:07 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:07 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab069977-8ccc-4feb-b7b0-edd5ed01f3b2 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.36df50b9-95a1-4412-841b-3cf5d08deb10" returned: 0 in 0.283s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab069977-8ccc-4feb-b7b0-edd5ed01f3b2 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:07 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.info Nov 06 18:52:07 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:07 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab069977-8ccc-4feb-b7b0-edd5ed01f3b2 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.info" returned: 0 in 0.336s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:07 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-ab069977-8ccc-4feb-b7b0-edd5ed01f3b2 tempest-ProjectMemberTests-1601559702 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.info is being set with open permissions: ugo+rw Nov 06 18:52:07 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab069977-8ccc-4feb-b7b0-edd5ed01f3b2 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:07 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.info Nov 06 18:52:07 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e5503559-c8aa-48ee-b695-4fd82283d528 tempest-VolumeDependencyTests-1339900225 None] Acquiring lock "cinder-bca2e78f-46ad-48db-81df-c5cad8c901a1-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e5503559-c8aa-48ee-b695-4fd82283d528 tempest-VolumeDependencyTests-1339900225 None] Lock "cinder-bca2e78f-46ad-48db-81df-c5cad8c901a1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:08 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ab069977-8ccc-4feb-b7b0-edd5ed01f3b2 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.info" returned: 0 in 0.425s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ab069977-8ccc-4feb-b7b0-edd5ed01f3b2 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e5503559-c8aa-48ee-b695-4fd82283d528 tempest-VolumeDependencyTests-1339900225 None] Acquiring lock "cinder-quobyte-bca2e78f-46ad-48db-81df-c5cad8c901a1" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e5503559-c8aa-48ee-b695-4fd82283d528 tempest-VolumeDependencyTests-1339900225 None] Lock "cinder-quobyte-bca2e78f-46ad-48db-81df-c5cad8c901a1" acquired by "delete_volume" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:08 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-ab069977-8ccc-4feb-b7b0-edd5ed01f3b2 tempest-ProjectMemberTests-1601559702 None] Create snapshot completed successfully Nov 06 18:52:08 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[debb51b8-29e1-4730-9891-9e42c996fdd2]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e5503559-c8aa-48ee-b695-4fd82283d528 tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:08 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 Nov 06 18:52:08 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:08 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e5503559-c8aa-48ee-b695-4fd82283d528 tempest-VolumeDependencyTests-1339900225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1" returned: 0 in 0.460s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:08 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e5503559-c8aa-48ee-b695-4fd82283d528 tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:08 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1 Nov 06 18:52:08 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:08 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-36df50b9-95a1-4412-841b-3cf5d08deb10-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-36df50b9-95a1-4412-841b-3cf5d08deb10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-0746872d-30f3-40e3-8df0-a9c7053ca70f" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-0746872d-30f3-40e3-8df0-a9c7053ca70f" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-36df50b9-95a1-4412-841b-3cf5d08deb10" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-36df50b9-95a1-4412-841b-3cf5d08deb10" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] Deleting offline snapshot 36df50b9-95a1-4412-841b-3cf5d08deb10 of volume 0746872d-30f3-40e3-8df0-a9c7053ca70f {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:52:09 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] snapshot_file for this snap is: volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.36df50b9-95a1-4412-841b-3cf5d08deb10 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e5503559-c8aa-48ee-b695-4fd82283d528 tempest-VolumeDependencyTests-1339900225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bca2e78f-46ad-48db-81df-c5cad8c901a1" returned: 0 in 0.342s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d397e3d-237a-4d1a-9c41-ac78ec5c2eca]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.36df50b9-95a1-4412-841b-3cf5d08deb10 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e5503559-c8aa-48ee-b695-4fd82283d528 tempest-VolumeDependencyTests-1339900225 None] Lock "cinder-quobyte-bca2e78f-46ad-48db-81df-c5cad8c901a1" released by "delete_volume" :: held 0.893s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-e5503559-c8aa-48ee-b695-4fd82283d528 tempest-VolumeDependencyTests-1339900225 None] Created reservations ['1c2b717d-70c2-4e93-9d8c-6a5f1619519c', 'd48cf2d1-73a3-4c45-819d-a530798a8665', '924c9712-8738-4654-86ea-a03bb915d8a6', '2028b2cb-f98c-4e8c-8ace-f76ccb16519b'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:52:09 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.36df50b9-95a1-4412-841b-3cf5d08deb10 Nov 06 18:52:09 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e5503559-c8aa-48ee-b695-4fd82283d528 tempest-VolumeDependencyTests-1339900225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e5503559-c8aa-48ee-b695-4fd82283d528 tempest-VolumeDependencyTests-1339900225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e5503559-c8aa-48ee-b695-4fd82283d528 tempest-VolumeDependencyTests-1339900225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e5503559-c8aa-48ee-b695-4fd82283d528 tempest-VolumeDependencyTests-1339900225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e5503559-c8aa-48ee-b695-4fd82283d528 tempest-VolumeDependencyTests-1339900225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e5503559-c8aa-48ee-b695-4fd82283d528 tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:09 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:52:09 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:09 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.36df50b9-95a1-4412-841b-3cf5d08deb10" returned: 0 in 0.552s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0746872d-30f3-40e3-8df0-a9c7053ca70f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:52:09 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e5503559-c8aa-48ee-b695-4fd82283d528 tempest-VolumeDependencyTests-1339900225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.370s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-e5503559-c8aa-48ee-b695-4fd82283d528 tempest-VolumeDependencyTests-1339900225 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[8442c274-5a7f-4dc1-b5bd-e471905bb960]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:09 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-e5503559-c8aa-48ee-b695-4fd82283d528 tempest-VolumeDependencyTests-1339900225 None] Deleted volume successfully. Nov 06 18:52:09 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e5503559-c8aa-48ee-b695-4fd82283d528 tempest-VolumeDependencyTests-1339900225 None] Lock "cinder-bca2e78f-46ad-48db-81df-c5cad8c901a1-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:09 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f Nov 06 18:52:09 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:10 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f" returned: 0 in 0.435s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.36df50b9-95a1-4412-841b-3cf5d08deb10 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:10 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.36df50b9-95a1-4412-841b-3cf5d08deb10 Nov 06 18:52:10 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f48bb08f-7690-4331-9c01-96aba6466139 tempest-VolumeDependencyTests-1339900225 None] Acquiring lock "cinder-1e72e02c-b3fe-485a-890a-ffc93d493579-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f48bb08f-7690-4331-9c01-96aba6466139 tempest-VolumeDependencyTests-1339900225 None] Lock "cinder-1e72e02c-b3fe-485a-890a-ffc93d493579-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f48bb08f-7690-4331-9c01-96aba6466139 tempest-VolumeDependencyTests-1339900225 None] Acquiring lock "cinder-quobyte-1e72e02c-b3fe-485a-890a-ffc93d493579" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:10 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f48bb08f-7690-4331-9c01-96aba6466139 tempest-VolumeDependencyTests-1339900225 None] Lock "cinder-quobyte-1e72e02c-b3fe-485a-890a-ffc93d493579" acquired by "delete_volume" :: waited 0.033s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:10 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dc855c-6000-485d-9fba-8e3f8d4605a7]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f48bb08f-7690-4331-9c01-96aba6466139 tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1e72e02c-b3fe-485a-890a-ffc93d493579 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:10 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.36df50b9-95a1-4412-841b-3cf5d08deb10" returned: 0 in 0.498s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.36df50b9-95a1-4412-841b-3cf5d08deb10 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:10 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.36df50b9-95a1-4412-841b-3cf5d08deb10 Nov 06 18:52:10 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:10 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1e72e02c-b3fe-485a-890a-ffc93d493579 Nov 06 18:52:10 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:10 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f.36df50b9-95a1-4412-841b-3cf5d08deb10" returned: 0 in 0.319s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:11 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-36df50b9-95a1-4412-841b-3cf5d08deb10" released by "_delete_snapshot" :: held 1.953s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:11 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-0746872d-30f3-40e3-8df0-a9c7053ca70f" released by "delete_snapshot" :: held 1.984s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:11 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f48bb08f-7690-4331-9c01-96aba6466139 tempest-VolumeDependencyTests-1339900225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1e72e02c-b3fe-485a-890a-ffc93d493579" returned: 0 in 0.454s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f48bb08f-7690-4331-9c01-96aba6466139 tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1e72e02c-b3fe-485a-890a-ffc93d493579 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:11 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1e72e02c-b3fe-485a-890a-ffc93d493579 Nov 06 18:52:11 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:11 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] Created reservations ['37bc832d-54e8-469d-b04f-0067868fae96', 'ceff26b3-53d3-401e-9170-4b5f8a1eecbf', '75ee81b7-9188-4ba0-a751-cb9b05dcb224', '2349f303-172d-4b3b-999f-57109212e52e'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:52:11 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] Delete snapshot completed successfully. Nov 06 18:52:11 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-56f936bf-3dd5-4cae-b9bd-588b9d519940 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-36df50b9-95a1-4412-841b-3cf5d08deb10-delete_snapshot" released by "delete_snapshot" :: held 2.207s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:11 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f48bb08f-7690-4331-9c01-96aba6466139 tempest-VolumeDependencyTests-1339900225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1e72e02c-b3fe-485a-890a-ffc93d493579" returned: 0 in 0.290s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:11 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f48bb08f-7690-4331-9c01-96aba6466139 tempest-VolumeDependencyTests-1339900225 None] Lock "cinder-quobyte-1e72e02c-b3fe-485a-890a-ffc93d493579" released by "delete_volume" :: held 0.808s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:11 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-f48bb08f-7690-4331-9c01-96aba6466139 tempest-VolumeDependencyTests-1339900225 None] Created reservations ['e8b5d6e3-2740-42a6-a529-2d0709c62e84', '755e02f3-45ce-4922-a039-69a1f8baa9e7', '27126180-ca89-427b-af45-706279a253d8', 'a5343391-8043-4081-974a-31d7053fbfa6'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:52:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f48bb08f-7690-4331-9c01-96aba6466139 tempest-VolumeDependencyTests-1339900225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f48bb08f-7690-4331-9c01-96aba6466139 tempest-VolumeDependencyTests-1339900225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f48bb08f-7690-4331-9c01-96aba6466139 tempest-VolumeDependencyTests-1339900225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-f48bb08f-7690-4331-9c01-96aba6466139 tempest-VolumeDependencyTests-1339900225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-f48bb08f-7690-4331-9c01-96aba6466139 tempest-VolumeDependencyTests-1339900225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f48bb08f-7690-4331-9c01-96aba6466139 tempest-VolumeDependencyTests-1339900225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:11 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:52:11 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:11 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f48bb08f-7690-4331-9c01-96aba6466139 tempest-VolumeDependencyTests-1339900225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.300s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:11 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-f48bb08f-7690-4331-9c01-96aba6466139 tempest-VolumeDependencyTests-1339900225 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:52:11 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-f48bb08f-7690-4331-9c01-96aba6466139 tempest-VolumeDependencyTests-1339900225 None] Deleted volume successfully. Nov 06 18:52:11 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f48bb08f-7690-4331-9c01-96aba6466139 tempest-VolumeDependencyTests-1339900225 None] Lock "cinder-1e72e02c-b3fe-485a-890a-ffc93d493579-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:12 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-308ca692-1696-4957-aec4-65eb3b36e246 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-0746872d-30f3-40e3-8df0-a9c7053ca70f-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:12 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-308ca692-1696-4957-aec4-65eb3b36e246 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-0746872d-30f3-40e3-8df0-a9c7053ca70f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:12 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-308ca692-1696-4957-aec4-65eb3b36e246 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-0746872d-30f3-40e3-8df0-a9c7053ca70f" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:12 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-308ca692-1696-4957-aec4-65eb3b36e246 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-0746872d-30f3-40e3-8df0-a9c7053ca70f" acquired by "delete_volume" :: waited 0.017s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:12 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[969c3805-7c5a-4149-adb8-c8400047b6b0]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-308ca692-1696-4957-aec4-65eb3b36e246 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:12 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f Nov 06 18:52:12 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:12 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-308ca692-1696-4957-aec4-65eb3b36e246 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f" returned: 0 in 0.574s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-308ca692-1696-4957-aec4-65eb3b36e246 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:13 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f Nov 06 18:52:13 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:13 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-308ca692-1696-4957-aec4-65eb3b36e246 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-0746872d-30f3-40e3-8df0-a9c7053ca70f" returned: 0 in 0.344s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-308ca692-1696-4957-aec4-65eb3b36e246 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-0746872d-30f3-40e3-8df0-a9c7053ca70f" released by "delete_volume" :: held 1.006s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:13 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-308ca692-1696-4957-aec4-65eb3b36e246 tempest-ProjectMemberTests-1601559702 None] Created reservations ['0cdce2fc-baef-4704-a9f5-635f163a4f4b', '9d114463-0fe6-447e-a25c-cbefb4c97e85', '1c2ed7f0-dacc-4e27-8d80-d149187a9e59', '22effcaf-a8b2-4d0b-b5f0-0832907fcdaf'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:52:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-308ca692-1696-4957-aec4-65eb3b36e246 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-308ca692-1696-4957-aec4-65eb3b36e246 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-308ca692-1696-4957-aec4-65eb3b36e246 tempest-ProjectMemberTests-1601559702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-308ca692-1696-4957-aec4-65eb3b36e246 tempest-ProjectMemberTests-1601559702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-308ca692-1696-4957-aec4-65eb3b36e246 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-308ca692-1696-4957-aec4-65eb3b36e246 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:13 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:52:13 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:13 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-308ca692-1696-4957-aec4-65eb3b36e246 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.334s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:13 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-308ca692-1696-4957-aec4-65eb3b36e246 tempest-ProjectMemberTests-1601559702 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:52:13 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-308ca692-1696-4957-aec4-65eb3b36e246 tempest-ProjectMemberTests-1601559702 None] Deleted volume successfully. Nov 06 18:52:14 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-308ca692-1696-4957-aec4-65eb3b36e246 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-0746872d-30f3-40e3-8df0-a9c7053ca70f-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Flow 'volume_create_manager' (4d701c70-e7a2-470d-a994-7fe04ec81e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f438586-9ee0-4840-b43d-137edaa2952f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f438586-9ee0-4840-b43d-137edaa2952f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1248491497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09707dcd-1d9f-4dc5-b92c-e3a9d9705459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a2d825e4974b0aa6a265daab4682d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:52:15Z,use_quota=True,user_id='40d648cb4ea342798df1a2c960e9d938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55efb178-37c3-47f9-951f-aca079a28426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55efb178-37c3-47f9-951f-aca079a28426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30b9f90f-0b6e-4894-a4f4-b1f8f478353c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30b9f90f-0b6e-4894-a4f4-b1f8f478353c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09707dcd-1d9f-4dc5-b92c-e3a9d9705459', 'volume_name': 'volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6912774d-d6b7-4dc0-80a6-f7de9db82e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6912774d-d6b7-4dc0-80a6-f7de9db82e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d124f274-a8e8-424e-8564-b6c52053e2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:15 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Volume 09707dcd-1d9f-4dc5-b92c-e3a9d9705459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459', 'volume_size': 1} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1248491497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09707dcd-1d9f-4dc5-b92c-e3a9d9705459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a2d825e4974b0aa6a265daab4682d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:52:15Z,use_quota=True,user_id='40d648cb4ea342798df1a2c960e9d938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Creating volume 09707dcd-1d9f-4dc5-b92c-e3a9d9705459 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:52:15 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:52:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:15 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459 1073741824 Nov 06 18:52:15 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:16 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459 1073741824" returned: 0 in 0.731s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:16 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459 Nov 06 18:52:16 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-f9cc54c4-e585-4eb0-8445-51c5fd89b43f tempest-ProjectAdminTests-1409522529 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7579803466797, 'free_capacity_gb': 1773.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86794) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 18:52:16 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459" returned: 0 in 0.398s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:52:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d124f274-a8e8-424e-8564-b6c52053e2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827362a4-97a3-416e-959c-408af788a8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:16 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Volume volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459 (09707dcd-1d9f-4dc5-b92c-e3a9d9705459): created successfully Nov 06 18:52:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827362a4-97a3-416e-959c-408af788a8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:16 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Flow 'volume_create_manager' (4d701c70-e7a2-470d-a994-7fe04ec81e0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:52:16 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-458b281f-102a-416e-9bf5-5c3b170d3c0e tempest-ProjectMemberTests-1601559702 None] Created volume successfully. Nov 06 18:52:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c851c406-df8d-4c14-8ae6-c2fd6ebf8f9b tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c851c406-df8d-4c14-8ae6-c2fd6ebf8f9b tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-c851c406-df8d-4c14-8ae6-c2fd6ebf8f9b tempest-ProjectMemberTests-1601559702 None] Creating offline snapshot cd58f41b-3a8a-4582-9ffd-7eb6cdec8266 of volume 09707dcd-1d9f-4dc5-b92c-e3a9d9705459 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:52:17 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca28ab9a-4e55-4564-aae5-af7b9ee80569]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c851c406-df8d-4c14-8ae6-c2fd6ebf8f9b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:17 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459 Nov 06 18:52:17 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:17 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c851c406-df8d-4c14-8ae6-c2fd6ebf8f9b tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459" returned: 0 in 0.419s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c851c406-df8d-4c14-8ae6-c2fd6ebf8f9b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.cd58f41b-3a8a-4582-9ffd-7eb6cdec8266 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:18 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.cd58f41b-3a8a-4582-9ffd-7eb6cdec8266 1G Nov 06 18:52:18 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:18 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c851c406-df8d-4c14-8ae6-c2fd6ebf8f9b tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.cd58f41b-3a8a-4582-9ffd-7eb6cdec8266 1G" returned: 0 in 0.502s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c851c406-df8d-4c14-8ae6-c2fd6ebf8f9b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.cd58f41b-3a8a-4582-9ffd-7eb6cdec8266 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:18 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.cd58f41b-3a8a-4582-9ffd-7eb6cdec8266 Nov 06 18:52:18 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:18 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c851c406-df8d-4c14-8ae6-c2fd6ebf8f9b tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.cd58f41b-3a8a-4582-9ffd-7eb6cdec8266" returned: 0 in 0.432s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:18 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-c851c406-df8d-4c14-8ae6-c2fd6ebf8f9b tempest-ProjectMemberTests-1601559702 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.cd58f41b-3a8a-4582-9ffd-7eb6cdec8266 is being set with open permissions: ugo+rw Nov 06 18:52:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c851c406-df8d-4c14-8ae6-c2fd6ebf8f9b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.cd58f41b-3a8a-4582-9ffd-7eb6cdec8266 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:18 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.cd58f41b-3a8a-4582-9ffd-7eb6cdec8266 Nov 06 18:52:18 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:19 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c851c406-df8d-4c14-8ae6-c2fd6ebf8f9b tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.cd58f41b-3a8a-4582-9ffd-7eb6cdec8266" returned: 0 in 0.357s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c851c406-df8d-4c14-8ae6-c2fd6ebf8f9b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:19 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.info Nov 06 18:52:19 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:19 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c851c406-df8d-4c14-8ae6-c2fd6ebf8f9b tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.info" returned: 0 in 0.332s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:19 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-c851c406-df8d-4c14-8ae6-c2fd6ebf8f9b tempest-ProjectMemberTests-1601559702 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.info is being set with open permissions: ugo+rw Nov 06 18:52:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c851c406-df8d-4c14-8ae6-c2fd6ebf8f9b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:19 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.info Nov 06 18:52:19 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:19 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c851c406-df8d-4c14-8ae6-c2fd6ebf8f9b tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.info" returned: 0 in 0.283s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c851c406-df8d-4c14-8ae6-c2fd6ebf8f9b tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.464s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:20 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c851c406-df8d-4c14-8ae6-c2fd6ebf8f9b tempest-ProjectMemberTests-1601559702 None] Create snapshot completed successfully Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-cd58f41b-3a8a-4582-9ffd-7eb6cdec8266-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Flow 'volume_create_manager' (0df1f58c-4a05-459e-aeeb-cde40658fab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e9cb9e-b9a2-4f03-9171-03afa43bec81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e9cb9e-b9a2-4f03-9171-03afa43bec81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1485425237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d5f960-9364-475b-80c9-3a808e0a9095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d586fed46d4d0f9f6761dbbc67690f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:52:21Z,use_quota=True,user_id='9c731ddb3038442a96d606c83f62f82f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66eafdc6-131b-4069-b64c-711cb384704b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66eafdc6-131b-4069-b64c-711cb384704b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80291dcc-8c66-46c6-a655-7e53a1c18d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80291dcc-8c66-46c6-a655-7e53a1c18d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4d5f960-9364-475b-80c9-3a808e0a9095', 'volume_name': 'volume-c4d5f960-9364-475b-80c9-3a808e0a9095', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a718329e-0c77-4b47-beb2-5d41eb2c4618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a718329e-0c77-4b47-beb2-5d41eb2c4618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01779d2-bd2f-479b-ab3e-8ce7ca7617c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:20 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Volume c4d5f960-9364-475b-80c9-3a808e0a9095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4d5f960-9364-475b-80c9-3a808e0a9095', 'volume_size': 1} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1485425237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d5f960-9364-475b-80c9-3a808e0a9095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d586fed46d4d0f9f6761dbbc67690f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:52:21Z,use_quota=True,user_id='9c731ddb3038442a96d606c83f62f82f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Creating volume c4d5f960-9364-475b-80c9-3a808e0a9095 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:52:20 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-cd58f41b-3a8a-4582-9ffd-7eb6cdec8266-delete_snapshot" acquired by "delete_snapshot" :: waited 0.142s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-09707dcd-1d9f-4dc5-b92c-e3a9d9705459" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-09707dcd-1d9f-4dc5-b92c-e3a9d9705459" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-cd58f41b-3a8a-4582-9ffd-7eb6cdec8266" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:20 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095 1073741824 Nov 06 18:52:20 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-cd58f41b-3a8a-4582-9ffd-7eb6cdec8266" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] Deleting offline snapshot cd58f41b-3a8a-4582-9ffd-7eb6cdec8266 of volume 09707dcd-1d9f-4dc5-b92c-e3a9d9705459 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] snapshot_file for this snap is: volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.cd58f41b-3a8a-4582-9ffd-7eb6cdec8266 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a85a555-16a7-496b-b01f-8120ad74b9dc]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.cd58f41b-3a8a-4582-9ffd-7eb6cdec8266 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:21 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.cd58f41b-3a8a-4582-9ffd-7eb6cdec8266 Nov 06 18:52:21 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:21 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095 1073741824" returned: 0 in 0.527s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:21 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.cd58f41b-3a8a-4582-9ffd-7eb6cdec8266" returned: 0 in 0.439s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9a6d5d-5e65-46f5-b0a0-64eabffc5334]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:21 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095 Nov 06 18:52:21 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:21 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459 Nov 06 18:52:21 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Flow 'volume_create_manager' (54256734-ffe3-4b25-9e7b-f97679e1d0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c604eed7-b05b-45ca-8cb3-be6dd6bfd72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:21 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095" returned: 0 in 0.375s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c604eed7-b05b-45ca-8cb3-be6dd6bfd72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-777250401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e9914e96c346b48ffb213ca9c5126f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:52:22Z,use_quota=True,user_id='24835ccfd0414b0792cf42b7addd02a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4340672-9e9d-47d3-9ea0-455bcf456111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4340672-9e9d-47d3-9ea0-455bcf456111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a7ebca-b167-4b10-83b0-e30aa9334bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a7ebca-b167-4b10-83b0-e30aa9334bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4', 'volume_name': 'volume-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2be548-f42e-40c6-a5b4-f9537db8ed3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2be548-f42e-40c6-a5b4-f9537db8ed3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dafea2e-8c9b-45bc-aa52-e527c6812b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:21 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Volume ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4', 'volume_size': 1} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-777250401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e9914e96c346b48ffb213ca9c5126f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:52:22Z,use_quota=True,user_id='24835ccfd0414b0792cf42b7addd02a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Creating volume ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:52:21 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:21 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01779d2-bd2f-479b-ab3e-8ce7ca7617c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d5f960-9364-475b-80c9-3a808e0a9095', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:21 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4 1073741824 Nov 06 18:52:21 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd366eee-5aa0-418f-8f7d-58e5befe0bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459" returned: 0 in 0.511s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.cd58f41b-3a8a-4582-9ffd-7eb6cdec8266 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:22 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Volume volume-c4d5f960-9364-475b-80c9-3a808e0a9095 (c4d5f960-9364-475b-80c9-3a808e0a9095): created successfully Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd366eee-5aa0-418f-8f7d-58e5befe0bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:22 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.cd58f41b-3a8a-4582-9ffd-7eb6cdec8266 Nov 06 18:52:22 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Flow 'volume_create_manager' (0df1f58c-4a05-459e-aeeb-cde40658fab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:52:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-88856dde-12dd-4b81-943d-038b069f67f6 tempest-SnapshotDependencyTests-477965450 None] Created volume successfully. Nov 06 18:52:22 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.cd58f41b-3a8a-4582-9ffd-7eb6cdec8266" returned: 0 in 0.374s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.cd58f41b-3a8a-4582-9ffd-7eb6cdec8266 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:22 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.cd58f41b-3a8a-4582-9ffd-7eb6cdec8266 Nov 06 18:52:22 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:22 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4 1073741824" returned: 0 in 0.475s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:22 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4 Nov 06 18:52:22 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:22 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459.cd58f41b-3a8a-4582-9ffd-7eb6cdec8266" returned: 0 in 0.257s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-cd58f41b-3a8a-4582-9ffd-7eb6cdec8266" released by "_delete_snapshot" :: held 1.710s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-09707dcd-1d9f-4dc5-b92c-e3a9d9705459" released by "delete_snapshot" :: held 1.734s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:22 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4" returned: 0 in 0.251s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dafea2e-8c9b-45bc-aa52-e527c6812b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ccb74af-e109-48ea-ae67-18ef8ff2f8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] Created reservations ['fa6d2375-5538-4448-9fec-3046b145e166', '6f6b45e5-6eac-4e04-966b-b1f0fd1a09cd', 'e4a79eb2-8431-4b86-bb78-54b9851b87c6', '04bf1444-4130-4f4f-a6a3-67a749a53e10'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:52:22 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Volume volume-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4 (ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4): created successfully Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ccb74af-e109-48ea-ae67-18ef8ff2f8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Flow 'volume_create_manager' (54256734-ffe3-4b25-9e7b-f97679e1d0da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:52:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-04c7e04b-a14d-40ea-972b-c730da207f8e tempest-ProjectReaderTests-423412816 None] Created volume successfully. Nov 06 18:52:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] Delete snapshot completed successfully. Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2a50f52e-ea22-435d-96eb-020fe01c1518 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-cd58f41b-3a8a-4582-9ffd-7eb6cdec8266-delete_snapshot" released by "delete_snapshot" :: held 1.925s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-37906a15-9be0-4db1-a90f-92eb35c0224e tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-09707dcd-1d9f-4dc5-b92c-e3a9d9705459-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-37906a15-9be0-4db1-a90f-92eb35c0224e tempest-ProjectMemberTests-1601559702 None] Lock "cinder-09707dcd-1d9f-4dc5-b92c-e3a9d9705459-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-37906a15-9be0-4db1-a90f-92eb35c0224e tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-09707dcd-1d9f-4dc5-b92c-e3a9d9705459" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-37906a15-9be0-4db1-a90f-92eb35c0224e tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-09707dcd-1d9f-4dc5-b92c-e3a9d9705459" acquired by "delete_volume" :: waited 0.014s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7658ccc7-eef9-4d9f-9d2e-d736e393c893]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-37906a15-9be0-4db1-a90f-92eb35c0224e tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-086c5001-5299-4935-8ef1-a0edea5cfe7f tempest-SnapshotDependencyTests-477965450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-086c5001-5299-4935-8ef1-a0edea5cfe7f tempest-SnapshotDependencyTests-477965450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-086c5001-5299-4935-8ef1-a0edea5cfe7f tempest-SnapshotDependencyTests-477965450 None] Creating offline snapshot c6273a3a-d063-4621-97c1-dd3ab0233129 of volume c4d5f960-9364-475b-80c9-3a808e0a9095 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[f143c040-fd71-4dce-a028-171886d93555]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-086c5001-5299-4935-8ef1-a0edea5cfe7f tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:23 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459 Nov 06 18:52:23 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:23 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095 Nov 06 18:52:23 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:23 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-37906a15-9be0-4db1-a90f-92eb35c0224e tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459" returned: 0 in 0.388s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-37906a15-9be0-4db1-a90f-92eb35c0224e tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:23 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459 Nov 06 18:52:23 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:23 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-086c5001-5299-4935-8ef1-a0edea5cfe7f tempest-SnapshotDependencyTests-477965450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095" returned: 0 in 0.443s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-086c5001-5299-4935-8ef1-a0edea5cfe7f tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:23 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129 1G Nov 06 18:52:23 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:23 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-37906a15-9be0-4db1-a90f-92eb35c0224e tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-09707dcd-1d9f-4dc5-b92c-e3a9d9705459" returned: 0 in 0.288s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-37906a15-9be0-4db1-a90f-92eb35c0224e tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-09707dcd-1d9f-4dc5-b92c-e3a9d9705459" released by "delete_volume" :: held 0.747s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-37906a15-9be0-4db1-a90f-92eb35c0224e tempest-ProjectMemberTests-1601559702 None] Created reservations ['4745cfa5-fd15-4d28-a031-affb15b656f2', 'b9324a65-cc75-4803-8979-976bc751380c', '0b59b7de-bb21-428c-ae61-eed352cd22b4', '670ce2c8-325e-4fb0-8bb0-3d12d12b7894'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-37906a15-9be0-4db1-a90f-92eb35c0224e tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-37906a15-9be0-4db1-a90f-92eb35c0224e tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-37906a15-9be0-4db1-a90f-92eb35c0224e tempest-ProjectMemberTests-1601559702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-37906a15-9be0-4db1-a90f-92eb35c0224e tempest-ProjectMemberTests-1601559702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-37906a15-9be0-4db1-a90f-92eb35c0224e tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-37906a15-9be0-4db1-a90f-92eb35c0224e tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:23 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:52:23 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-344b6c19-ec1e-41c1-8d6e-a69e3a37c3d1 tempest-ProjectReaderTests-423412816 None] Acquiring lock "cinder-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-344b6c19-ec1e-41c1-8d6e-a69e3a37c3d1 tempest-ProjectReaderTests-423412816 None] Lock "cinder-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:24 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-086c5001-5299-4935-8ef1-a0edea5cfe7f tempest-SnapshotDependencyTests-477965450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129 1G" returned: 0 in 0.536s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-086c5001-5299-4935-8ef1-a0edea5cfe7f tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d5f960-9364-475b-80c9-3a808e0a9095 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:24 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d5f960-9364-475b-80c9-3a808e0a9095 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129 Nov 06 18:52:24 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-344b6c19-ec1e-41c1-8d6e-a69e3a37c3d1 tempest-ProjectReaderTests-423412816 None] Acquiring lock "cinder-quobyte-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-344b6c19-ec1e-41c1-8d6e-a69e3a37c3d1 tempest-ProjectReaderTests-423412816 None] Lock "cinder-quobyte-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4" acquired by "delete_volume" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc98fa0-1822-4d9e-8a63-3695f1043536]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-344b6c19-ec1e-41c1-8d6e-a69e3a37c3d1 tempest-ProjectReaderTests-423412816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:24 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-37906a15-9be0-4db1-a90f-92eb35c0224e tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.413s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-37906a15-9be0-4db1-a90f-92eb35c0224e tempest-ProjectMemberTests-1601559702 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:52:24 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-37906a15-9be0-4db1-a90f-92eb35c0224e tempest-ProjectMemberTests-1601559702 None] Deleted volume successfully. Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-37906a15-9be0-4db1-a90f-92eb35c0224e tempest-ProjectMemberTests-1601559702 None] Lock "cinder-09707dcd-1d9f-4dc5-b92c-e3a9d9705459-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:24 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4 Nov 06 18:52:24 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:24 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-086c5001-5299-4935-8ef1-a0edea5cfe7f tempest-SnapshotDependencyTests-477965450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d5f960-9364-475b-80c9-3a808e0a9095 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129" returned: 0 in 0.388s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:24 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-086c5001-5299-4935-8ef1-a0edea5cfe7f tempest-SnapshotDependencyTests-477965450 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129 is being set with open permissions: ugo+rw Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-086c5001-5299-4935-8ef1-a0edea5cfe7f tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:24 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129 Nov 06 18:52:24 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:24 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-344b6c19-ec1e-41c1-8d6e-a69e3a37c3d1 tempest-ProjectReaderTests-423412816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4" returned: 0 in 0.436s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-344b6c19-ec1e-41c1-8d6e-a69e3a37c3d1 tempest-ProjectReaderTests-423412816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:24 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4 Nov 06 18:52:24 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:24 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-086c5001-5299-4935-8ef1-a0edea5cfe7f tempest-SnapshotDependencyTests-477965450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129" returned: 0 in 0.271s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Flow 'volume_create_manager' (5bd0731e-d109-493d-9d0f-c56c1dd3dd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12852f2d-3541-4376-a0fd-7079dc83b4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-086c5001-5299-4935-8ef1-a0edea5cfe7f tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12852f2d-3541-4376-a0fd-7079dc83b4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1218048529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24856fd6-ed6c-43c2-8c83-4927a9ec9664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a2d825e4974b0aa6a265daab4682d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:52:25Z,use_quota=True,user_id='40d648cb4ea342798df1a2c960e9d938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:24 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.info Nov 06 18:52:24 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec19c45-8737-4832-bc1b-c8d5333c51f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec19c45-8737-4832-bc1b-c8d5333c51f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0a293c-67c6-477f-a194-891adc58a2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0a293c-67c6-477f-a194-891adc58a2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24856fd6-ed6c-43c2-8c83-4927a9ec9664', 'volume_name': 'volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888ac593-cdb4-4387-9bcd-bf57195ed88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888ac593-cdb4-4387-9bcd-bf57195ed88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9ea6c2-4476-4e76-a724-7e1c37c31ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:24 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Volume 24856fd6-ed6c-43c2-8c83-4927a9ec9664: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664', 'volume_size': 1} Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:24 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-344b6c19-ec1e-41c1-8d6e-a69e3a37c3d1 tempest-ProjectReaderTests-423412816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4" returned: 0 in 0.273s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:24 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-344b6c19-ec1e-41c1-8d6e-a69e3a37c3d1 tempest-ProjectReaderTests-423412816 None] Lock "cinder-quobyte-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4" released by "delete_volume" :: held 0.769s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-344b6c19-ec1e-41c1-8d6e-a69e3a37c3d1 tempest-ProjectReaderTests-423412816 None] Created reservations ['821771a5-46c5-4936-9ac5-b3700c1b015b', 'a4c04dce-2b26-49ee-ae48-8afdba790afe', '36bf914b-28dd-4c80-ba21-b8f039c0233f', '7b264f57-1355-4758-a079-7030cedda3c3'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-344b6c19-ec1e-41c1-8d6e-a69e3a37c3d1 tempest-ProjectReaderTests-423412816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-344b6c19-ec1e-41c1-8d6e-a69e3a37c3d1 tempest-ProjectReaderTests-423412816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-344b6c19-ec1e-41c1-8d6e-a69e3a37c3d1 tempest-ProjectReaderTests-423412816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-344b6c19-ec1e-41c1-8d6e-a69e3a37c3d1 tempest-ProjectReaderTests-423412816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-344b6c19-ec1e-41c1-8d6e-a69e3a37c3d1 tempest-ProjectReaderTests-423412816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-344b6c19-ec1e-41c1-8d6e-a69e3a37c3d1 tempest-ProjectReaderTests-423412816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:25 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:52:25 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:25 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-086c5001-5299-4935-8ef1-a0edea5cfe7f tempest-SnapshotDependencyTests-477965450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.info" returned: 0 in 0.263s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:25 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-086c5001-5299-4935-8ef1-a0edea5cfe7f tempest-SnapshotDependencyTests-477965450 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.info is being set with open permissions: ugo+rw Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-086c5001-5299-4935-8ef1-a0edea5cfe7f tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:25 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.info Nov 06 18:52:25 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:25 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-344b6c19-ec1e-41c1-8d6e-a69e3a37c3d1 tempest-ProjectReaderTests-423412816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.289s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-344b6c19-ec1e-41c1-8d6e-a69e3a37c3d1 tempest-ProjectReaderTests-423412816 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:52:25 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-344b6c19-ec1e-41c1-8d6e-a69e3a37c3d1 tempest-ProjectReaderTests-423412816 None] Deleted volume successfully. Nov 06 18:52:25 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-344b6c19-ec1e-41c1-8d6e-a69e3a37c3d1 tempest-ProjectReaderTests-423412816 None] Lock "cinder-ccf8b951-8a58-4bc5-bac7-d6fdfd36d7e4-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-086c5001-5299-4935-8ef1-a0edea5cfe7f tempest-SnapshotDependencyTests-477965450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.info" returned: 0 in 0.293s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-086c5001-5299-4935-8ef1-a0edea5cfe7f tempest-SnapshotDependencyTests-477965450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.343s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1218048529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24856fd6-ed6c-43c2-8c83-4927a9ec9664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a2d825e4974b0aa6a265daab4682d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:52:25Z,use_quota=True,user_id='40d648cb4ea342798df1a2c960e9d938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Creating volume 24856fd6-ed6c-43c2-8c83-4927a9ec9664 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:52:25 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:25 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664 1073741824 Nov 06 18:52:25 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:25 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-086c5001-5299-4935-8ef1-a0edea5cfe7f tempest-SnapshotDependencyTests-477965450 None] Create snapshot completed successfully Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Flow 'volume_create_manager' (9ad4fb45-6e13-40ef-a9bd-80e68f51cdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8674db10-e2be-4e87-90d4-0f14849085d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8674db10-e2be-4e87-90d4-0f14849085d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-30544285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e9914e96c346b48ffb213ca9c5126f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:52:26Z,use_quota=True,user_id='24835ccfd0414b0792cf42b7addd02a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b87849-7af7-4c2a-a757-bf91432e4483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b87849-7af7-4c2a-a757-bf91432e4483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d9f923-fd6c-4bf1-a9c3-ac56fd28ac1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d9f923-fd6c-4bf1-a9c3-ac56fd28ac1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08', 'volume_name': 'volume-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a4c64f-9abe-43d9-ba32-53595b1fd46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a4c64f-9abe-43d9-ba32-53595b1fd46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757bf746-64ee-419d-ae81-7f95466cd337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:25 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Volume b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08', 'volume_size': 1} Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:25 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664 1073741824" returned: 0 in 0.512s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:26 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664 Nov 06 18:52:26 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:26 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664" returned: 0 in 0.252s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:26 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:52:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.346s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:26 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-30544285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e9914e96c346b48ffb213ca9c5126f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:52:26Z,use_quota=True,user_id='24835ccfd0414b0792cf42b7addd02a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:52:26 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Creating volume b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:52:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:26 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:26 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:26 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:52:26 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:52:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9ea6c2-4476-4e76-a724-7e1c37c31ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:26 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08 1073741824 Nov 06 18:52:26 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecf7c0a-a1b0-4453-ad2a-bf57fefa30f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:26 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Volume volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664 (24856fd6-ed6c-43c2-8c83-4927a9ec9664): created successfully Nov 06 18:52:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecf7c0a-a1b0-4453-ad2a-bf57fefa30f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:26 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Flow 'volume_create_manager' (5bd0731e-d109-493d-9d0f-c56c1dd3dd09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:52:26 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-6be0275f-a27e-4f15-99ff-91342e35ffaf tempest-ProjectMemberTests-1601559702 None] Created volume successfully. Nov 06 18:52:26 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08 1073741824" returned: 0 in 0.509s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:26 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08 Nov 06 18:52:26 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Flow 'volume_create_manager' (20604548-225b-41ba-a1a7-c4e9801fd555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c0254a-bdb8-441a-ad85-d798dcc5843f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c0254a-bdb8-441a-ad85-d798dcc5843f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d3a89d5-8f92-4389-a184-c5f59a321158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d586fed46d4d0f9f6761dbbc67690f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c6273a3a-d063-4621-97c1-dd3ab0233129,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:52:27Z,use_quota=True,user_id='9c731ddb3038442a96d606c83f62f82f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2051d3f1-8593-43b8-8e7b-539c7a628e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2051d3f1-8593-43b8-8e7b-539c7a628e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3b3875-9711-4adc-b6bc-18bcc55c86b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3b3875-9711-4adc-b6bc-18bcc55c86b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1d3a89d5-8f92-4389-a184-c5f59a321158', 'volume_name': 'volume-1d3a89d5-8f92-4389-a184-c5f59a321158', 'volume_size': 1, 'snapshot_id': 'c6273a3a-d063-4621-97c1-dd3ab0233129'}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba55adb-1bf8-44fc-9d05-293052a86e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba55adb-1bf8-44fc-9d05-293052a86e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcfba3bc-5ee6-4fce-af19-0d53611b245f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:27 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Volume 1d3a89d5-8f92-4389-a184-c5f59a321158: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1d3a89d5-8f92-4389-a184-c5f59a321158', 'volume_size': 1, 'snapshot_id': 'c6273a3a-d063-4621-97c1-dd3ab0233129'} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5c51fbd7-a8a5-41a9-8fdc-9ffa49842403 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:27 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08" returned: 0 in 0.340s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.029s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Acquiring lock "cinder-quobyte-c6273a3a-d063-4621-97c1-dd3ab0233129-1d3a89d5-8f92-4389-a184-c5f59a321158" by "_create_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757bf746-64ee-419d-ae81-7f95466cd337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a6ec0a-d6cc-4ce5-ab20-212a4a4d47a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Lock "cinder-quobyte-c6273a3a-d063-4621-97c1-dd3ab0233129-1d3a89d5-8f92-4389-a184-c5f59a321158" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Creating volume 1d3a89d5-8f92-4389-a184-c5f59a321158 from snapshot c6273a3a-d063-4621-97c1-dd3ab0233129 {{(pid=86794) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Acquiring lock "cinder-quobyte-1d3a89d5-8f92-4389-a184-c5f59a321158" by "_copy_volume_from_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:27 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Volume volume-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08 (b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08): created successfully Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a6ec0a-d6cc-4ce5-ab20-212a4a4d47a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Flow 'volume_create_manager' (9ad4fb45-6e13-40ef-a9bd-80e68f51cdb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Lock "cinder-quobyte-1d3a89d5-8f92-4389-a184-c5f59a321158" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] snapshot: c6273a3a-d063-4621-97c1-dd3ab0233129, volume: 1d3a89d5-8f92-4389-a184-c5f59a321158, {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 18:52:27 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c4c95c0f-54e2-4d3a-8935-8e390543b450 tempest-ProjectReaderTests-423412816 None] Created volume successfully. Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bd1ce6-48b2-4339-842e-b5a75e2b0be5]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:27 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129 Nov 06 18:52:27 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:27 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129" returned: 0 in 0.414s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d5f960-9364-475b-80c9-3a808e0a9095(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bca267-e349-4a50-8175-5a7a1a41977c]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:27 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095 Nov 06 18:52:27 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-95feb175-6a91-49b9-81ae-a9ae8a15ef44 tempest-ProjectReaderTests-423412816 None] Acquiring lock "cinder-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-95feb175-6a91-49b9-81ae-a9ae8a15ef44 tempest-ProjectReaderTests-423412816 None] Lock "cinder-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:28 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-95feb175-6a91-49b9-81ae-a9ae8a15ef44 tempest-ProjectReaderTests-423412816 None] Acquiring lock "cinder-quobyte-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:28 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-95feb175-6a91-49b9-81ae-a9ae8a15ef44 tempest-ProjectReaderTests-423412816 None] Lock "cinder-quobyte-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08" acquired by "delete_volume" :: waited 0.024s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:28 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[2291dc0b-da03-479b-8304-e62cd517e4fb]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-95feb175-6a91-49b9-81ae-a9ae8a15ef44 tempest-ProjectReaderTests-423412816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:28 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095" returned: 0 in 0.475s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095 {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 18:52:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Creating direct copy from snapshot {{(pid=86794) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 18:52:28 devstack cinder-volume[86794]: DEBUG cinder.utils [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Path /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1d3a89d5-8f92-4389-a184-c5f59a321158 not found in is_blk_device check {{(pid=86794) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 18:52:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1d3a89d5-8f92-4389-a184-c5f59a321158 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:28 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08 Nov 06 18:52:28 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:28 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1d3a89d5-8f92-4389-a184-c5f59a321158 Nov 06 18:52:28 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:28 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-95feb175-6a91-49b9-81ae-a9ae8a15ef44 tempest-ProjectReaderTests-423412816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08" returned: 0 in 0.448s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-95feb175-6a91-49b9-81ae-a9ae8a15ef44 tempest-ProjectReaderTests-423412816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:28 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08 Nov 06 18:52:28 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:28 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-95feb175-6a91-49b9-81ae-a9ae8a15ef44 tempest-ProjectReaderTests-423412816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08" returned: 0 in 0.343s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:28 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-95feb175-6a91-49b9-81ae-a9ae8a15ef44 tempest-ProjectReaderTests-423412816 None] Lock "cinder-quobyte-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08" released by "delete_volume" :: held 0.881s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-95feb175-6a91-49b9-81ae-a9ae8a15ef44 tempest-ProjectReaderTests-423412816 None] Created reservations ['4568d338-a971-4169-b840-cf7999fdc44f', '32af6dd9-e7ec-4875-8c91-de4c20502124', 'ea5e48db-592e-434c-b367-8189fb50b9c1', '2048ca98-e86f-4876-8411-0aff6ad174f9'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-95feb175-6a91-49b9-81ae-a9ae8a15ef44 tempest-ProjectReaderTests-423412816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-95feb175-6a91-49b9-81ae-a9ae8a15ef44 tempest-ProjectReaderTests-423412816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-95feb175-6a91-49b9-81ae-a9ae8a15ef44 tempest-ProjectReaderTests-423412816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-95feb175-6a91-49b9-81ae-a9ae8a15ef44 tempest-ProjectReaderTests-423412816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-95feb175-6a91-49b9-81ae-a9ae8a15ef44 tempest-ProjectReaderTests-423412816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-95feb175-6a91-49b9-81ae-a9ae8a15ef44 tempest-ProjectReaderTests-423412816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:29 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:52:29 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:29 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:52:29 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:29 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-95feb175-6a91-49b9-81ae-a9ae8a15ef44 tempest-ProjectReaderTests-423412816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.577s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-95feb175-6a91-49b9-81ae-a9ae8a15ef44 tempest-ProjectReaderTests-423412816 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:52:29 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:29 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-95feb175-6a91-49b9-81ae-a9ae8a15ef44 tempest-ProjectReaderTests-423412816 None] Deleted volume successfully. Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.465s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 29 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:52:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-95feb175-6a91-49b9-81ae-a9ae8a15ef44 tempest-ProjectReaderTests-423412816 None] Lock "cinder-b2dd8dc2-ba42-4a6c-826d-3cb2685b0e08-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:36 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1d3a89d5-8f92-4389-a184-c5f59a321158" returned: 0 in 8.255s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:36 devstack cinder-volume[86794]: DEBUG cinder.image.image_utils [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095, size 1024.00 MB, duration 8.26 sec, destination /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1d3a89d5-8f92-4389-a184-c5f59a321158 {{(pid=86794) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 18:52:36 devstack cinder-volume[86794]: INFO cinder.image.image_utils [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Converted 1024.00 MB image at 124.03 MB/s Nov 06 18:52:36 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1d3a89d5-8f92-4389-a184-c5f59a321158 is being set with open permissions: ugo+rw Nov 06 18:52:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1d3a89d5-8f92-4389-a184-c5f59a321158 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:36 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1d3a89d5-8f92-4389-a184-c5f59a321158 Nov 06 18:52:36 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:36 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1d3a89d5-8f92-4389-a184-c5f59a321158" returned: 0 in 0.281s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Lock "cinder-quobyte-1d3a89d5-8f92-4389-a184-c5f59a321158" released by "_copy_volume_from_snapshot" :: held 9.532s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Lock "cinder-quobyte-c6273a3a-d063-4621-97c1-dd3ab0233129-1d3a89d5-8f92-4389-a184-c5f59a321158" released by "_create_volume_from_snapshot" :: held 9.627s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.659s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5c51fbd7-a8a5-41a9-8fdc-9ffa49842403 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.679s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:36 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-5c51fbd7-a8a5-41a9-8fdc-9ffa49842403 tempest-ProjectMemberTests-1601559702 None] Creating offline snapshot 4e03add8-7e87-4848-8070-c5872183e1c7 of volume 24856fd6-ed6c-43c2-8c83-4927a9ec9664 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:52:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcfba3bc-5ee6-4fce-af19-0d53611b245f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d3a89d5-8f92-4389-a184-c5f59a321158', 'volume_size': 1, 'snapshot_id': 'c6273a3a-d063-4621-97c1-dd3ab0233129'}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca0087c-2e46-4bf4-9f55-dffeb7a5109f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:36 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[227e0d8f-043f-417f-888b-772f0b621afc]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5c51fbd7-a8a5-41a9-8fdc-9ffa49842403 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:36 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Volume volume-1d3a89d5-8f92-4389-a184-c5f59a321158 (1d3a89d5-8f92-4389-a184-c5f59a321158): created successfully Nov 06 18:52:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca0087c-2e46-4bf4-9f55-dffeb7a5109f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:36 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Flow 'volume_create_manager' (20604548-225b-41ba-a1a7-c4e9801fd555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:52:36 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-67749d62-1c28-4909-a7ab-f873107c4c6c tempest-SnapshotDependencyTests-477965450 None] Created volume successfully. Nov 06 18:52:37 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664 Nov 06 18:52:37 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:37 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5c51fbd7-a8a5-41a9-8fdc-9ffa49842403 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664" returned: 0 in 0.424s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5c51fbd7-a8a5-41a9-8fdc-9ffa49842403 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.4e03add8-7e87-4848-8070-c5872183e1c7 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:37 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.4e03add8-7e87-4848-8070-c5872183e1c7 1G Nov 06 18:52:37 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:37 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5c51fbd7-a8a5-41a9-8fdc-9ffa49842403 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.4e03add8-7e87-4848-8070-c5872183e1c7 1G" returned: 0 in 0.482s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5c51fbd7-a8a5-41a9-8fdc-9ffa49842403 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.4e03add8-7e87-4848-8070-c5872183e1c7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:37 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.4e03add8-7e87-4848-8070-c5872183e1c7 Nov 06 18:52:37 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] Acquiring lock "cinder-c6273a3a-d063-4621-97c1-dd3ab0233129-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:38 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5c51fbd7-a8a5-41a9-8fdc-9ffa49842403 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.4e03add8-7e87-4848-8070-c5872183e1c7" returned: 0 in 0.405s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:38 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-5c51fbd7-a8a5-41a9-8fdc-9ffa49842403 tempest-ProjectMemberTests-1601559702 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.4e03add8-7e87-4848-8070-c5872183e1c7 is being set with open permissions: ugo+rw Nov 06 18:52:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5c51fbd7-a8a5-41a9-8fdc-9ffa49842403 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.4e03add8-7e87-4848-8070-c5872183e1c7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] Lock "cinder-c6273a3a-d063-4621-97c1-dd3ab0233129-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] Acquiring lock "cinder-quobyte-c4d5f960-9364-475b-80c9-3a808e0a9095" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] Lock "cinder-quobyte-c4d5f960-9364-475b-80c9-3a808e0a9095" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] Acquiring lock "cinder-quobyte-c6273a3a-d063-4621-97c1-dd3ab0233129" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:38 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.4e03add8-7e87-4848-8070-c5872183e1c7 Nov 06 18:52:38 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] Lock "cinder-quobyte-c6273a3a-d063-4621-97c1-dd3ab0233129" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] Deleting offline snapshot c6273a3a-d063-4621-97c1-dd3ab0233129 of volume c4d5f960-9364-475b-80c9-3a808e0a9095 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:52:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] snapshot_file for this snap is: volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:52:38 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb97b5e-ea6a-484d-9cc0-53bf22d7b71f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:38 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129 Nov 06 18:52:38 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:38 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5c51fbd7-a8a5-41a9-8fdc-9ffa49842403 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.4e03add8-7e87-4848-8070-c5872183e1c7" returned: 0 in 0.287s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5c51fbd7-a8a5-41a9-8fdc-9ffa49842403 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:38 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.info Nov 06 18:52:38 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:38 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129" returned: 0 in 0.470s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d5f960-9364-475b-80c9-3a808e0a9095(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:52:38 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a785e2-fe6c-4ab0-afa5-9e33b0a1aa70]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:38 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5c51fbd7-a8a5-41a9-8fdc-9ffa49842403 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.info" returned: 0 in 0.357s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:38 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-5c51fbd7-a8a5-41a9-8fdc-9ffa49842403 tempest-ProjectMemberTests-1601559702 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.info is being set with open permissions: ugo+rw Nov 06 18:52:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5c51fbd7-a8a5-41a9-8fdc-9ffa49842403 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:38 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.info Nov 06 18:52:38 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:38 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095 Nov 06 18:52:38 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:39 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5c51fbd7-a8a5-41a9-8fdc-9ffa49842403 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.info" returned: 0 in 0.283s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-5c51fbd7-a8a5-41a9-8fdc-9ffa49842403 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.378s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:39 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-5c51fbd7-a8a5-41a9-8fdc-9ffa49842403 tempest-ProjectMemberTests-1601559702 None] Create snapshot completed successfully Nov 06 18:52:39 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095" returned: 0 in 0.573s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:39 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129 Nov 06 18:52:39 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:39 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129" returned: 0 in 0.340s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:39 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129 Nov 06 18:52:39 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-4e03add8-7e87-4848-8070-c5872183e1c7-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-4e03add8-7e87-4848-8070-c5872183e1c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-24856fd6-ed6c-43c2-8c83-4927a9ec9664" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-24856fd6-ed6c-43c2-8c83-4927a9ec9664" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-4e03add8-7e87-4848-8070-c5872183e1c7" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:40 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095.c6273a3a-d063-4621-97c1-dd3ab0233129" returned: 0 in 0.283s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-4e03add8-7e87-4848-8070-c5872183e1c7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] Deleting offline snapshot 4e03add8-7e87-4848-8070-c5872183e1c7 of volume 24856fd6-ed6c-43c2-8c83-4927a9ec9664 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] snapshot_file for this snap is: volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.4e03add8-7e87-4848-8070-c5872183e1c7 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf68d5a-6d41-46f4-aa28-6b44c9cc0582]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.4e03add8-7e87-4848-8070-c5872183e1c7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] Lock "cinder-quobyte-c6273a3a-d063-4621-97c1-dd3ab0233129" released by "_delete_snapshot" :: held 1.859s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] Lock "cinder-quobyte-c4d5f960-9364-475b-80c9-3a808e0a9095" released by "delete_snapshot" :: held 1.885s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] Created reservations ['a8c50f72-16c0-491b-ad22-5e613bafd1aa', '40e727c8-a820-4f16-82e5-656707b1e272', '4910dfaf-0159-40cc-998a-49a3fe4f29ca', 'ec608b1d-4ad5-40e9-9f10-70272c346c64'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:52:40 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.4e03add8-7e87-4848-8070-c5872183e1c7 Nov 06 18:52:40 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:40 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] Delete snapshot completed successfully. Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2d0c7902-8a1d-44a2-9d9c-ee441b37abda tempest-SnapshotDependencyTests-477965450 None] Lock "cinder-c6273a3a-d063-4621-97c1-dd3ab0233129-delete_snapshot" released by "delete_snapshot" :: held 2.040s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-74a7230e-5eb7-4ddd-b998-b854a1588292 tempest-SnapshotDependencyTests-477965450 None] Acquiring lock "cinder-c4d5f960-9364-475b-80c9-3a808e0a9095-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-74a7230e-5eb7-4ddd-b998-b854a1588292 tempest-SnapshotDependencyTests-477965450 None] Lock "cinder-c4d5f960-9364-475b-80c9-3a808e0a9095-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-74a7230e-5eb7-4ddd-b998-b854a1588292 tempest-SnapshotDependencyTests-477965450 None] Acquiring lock "cinder-quobyte-c4d5f960-9364-475b-80c9-3a808e0a9095" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-74a7230e-5eb7-4ddd-b998-b854a1588292 tempest-SnapshotDependencyTests-477965450 None] Lock "cinder-quobyte-c4d5f960-9364-475b-80c9-3a808e0a9095" acquired by "delete_volume" :: waited 0.023s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[764e6521-aed1-43dd-8cc1-ba6af7b27148]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-74a7230e-5eb7-4ddd-b998-b854a1588292 tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:40 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.4e03add8-7e87-4848-8070-c5872183e1c7" returned: 0 in 0.421s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[55428a05-293b-4198-9beb-95b3e0923a0b]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:40 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095 Nov 06 18:52:40 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:40 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664 Nov 06 18:52:40 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:40 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-74a7230e-5eb7-4ddd-b998-b854a1588292 tempest-SnapshotDependencyTests-477965450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095" returned: 0 in 0.397s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-74a7230e-5eb7-4ddd-b998-b854a1588292 tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:40 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095 Nov 06 18:52:40 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:40 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664" returned: 0 in 0.399s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.4e03add8-7e87-4848-8070-c5872183e1c7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:41 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.4e03add8-7e87-4848-8070-c5872183e1c7 Nov 06 18:52:41 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:41 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-74a7230e-5eb7-4ddd-b998-b854a1588292 tempest-SnapshotDependencyTests-477965450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c4d5f960-9364-475b-80c9-3a808e0a9095" returned: 0 in 0.287s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-74a7230e-5eb7-4ddd-b998-b854a1588292 tempest-SnapshotDependencyTests-477965450 None] Lock "cinder-quobyte-c4d5f960-9364-475b-80c9-3a808e0a9095" released by "delete_volume" :: held 0.771s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-74a7230e-5eb7-4ddd-b998-b854a1588292 tempest-SnapshotDependencyTests-477965450 None] Created reservations ['37760516-b205-48a7-bbf8-6b8681b6a2c2', '2b59ea83-304a-4230-b9c5-df99df379c71', 'f43c25a1-9641-469d-9e29-727a9a489833', 'da0abd9c-2f73-4f58-b809-78c683c96d02'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-74a7230e-5eb7-4ddd-b998-b854a1588292 tempest-SnapshotDependencyTests-477965450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-74a7230e-5eb7-4ddd-b998-b854a1588292 tempest-SnapshotDependencyTests-477965450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-74a7230e-5eb7-4ddd-b998-b854a1588292 tempest-SnapshotDependencyTests-477965450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-74a7230e-5eb7-4ddd-b998-b854a1588292 tempest-SnapshotDependencyTests-477965450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-74a7230e-5eb7-4ddd-b998-b854a1588292 tempest-SnapshotDependencyTests-477965450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-74a7230e-5eb7-4ddd-b998-b854a1588292 tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:41 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:52:41 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:41 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.4e03add8-7e87-4848-8070-c5872183e1c7" returned: 0 in 0.420s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.4e03add8-7e87-4848-8070-c5872183e1c7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:41 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.4e03add8-7e87-4848-8070-c5872183e1c7 Nov 06 18:52:41 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-96b76266-ddea-4919-ad37-e84e8ea0b875 tempest-SnapshotDependencyTests-477965450 None] Acquiring lock "cinder-1d3a89d5-8f92-4389-a184-c5f59a321158-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-96b76266-ddea-4919-ad37-e84e8ea0b875 tempest-SnapshotDependencyTests-477965450 None] Lock "cinder-1d3a89d5-8f92-4389-a184-c5f59a321158-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-96b76266-ddea-4919-ad37-e84e8ea0b875 tempest-SnapshotDependencyTests-477965450 None] Acquiring lock "cinder-quobyte-1d3a89d5-8f92-4389-a184-c5f59a321158" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-96b76266-ddea-4919-ad37-e84e8ea0b875 tempest-SnapshotDependencyTests-477965450 None] Lock "cinder-quobyte-1d3a89d5-8f92-4389-a184-c5f59a321158" acquired by "delete_volume" :: waited 0.025s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:41 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-74a7230e-5eb7-4ddd-b998-b854a1588292 tempest-SnapshotDependencyTests-477965450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.358s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-74a7230e-5eb7-4ddd-b998-b854a1588292 tempest-SnapshotDependencyTests-477965450 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:52:41 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:41 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-74a7230e-5eb7-4ddd-b998-b854a1588292 tempest-SnapshotDependencyTests-477965450 None] Deleted volume successfully. Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664.4e03add8-7e87-4848-8070-c5872183e1c7" returned: 0 in 0.341s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2e9e31-0c8c-463f-899f-fd13e980efc3]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-96b76266-ddea-4919-ad37-e84e8ea0b875 tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1d3a89d5-8f92-4389-a184-c5f59a321158 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-4e03add8-7e87-4848-8070-c5872183e1c7" released by "_delete_snapshot" :: held 1.737s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-74a7230e-5eb7-4ddd-b998-b854a1588292 tempest-SnapshotDependencyTests-477965450 None] Lock "cinder-c4d5f960-9364-475b-80c9-3a808e0a9095-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-24856fd6-ed6c-43c2-8c83-4927a9ec9664" released by "delete_snapshot" :: held 1.773s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] Created reservations ['e8719157-917f-40b4-8aee-000a24f3b3b3', '52bd8db9-9bd9-41f6-9cc2-70faf4db359c', '1b378119-2bc7-49e5-b37b-cfe1a9474af4', 'cbd33f3d-f847-4398-97d1-ab3784e07e18'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:52:41 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1d3a89d5-8f92-4389-a184-c5f59a321158 Nov 06 18:52:41 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:41 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] Delete snapshot completed successfully. Nov 06 18:52:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-4109199a-89a9-4fb5-a328-57fbd3ad4555 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-4e03add8-7e87-4848-8070-c5872183e1c7-delete_snapshot" released by "delete_snapshot" :: held 1.930s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7015fa11-00c9-4a59-b7e9-6e8f794efdec tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-24856fd6-ed6c-43c2-8c83-4927a9ec9664-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:42 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7015fa11-00c9-4a59-b7e9-6e8f794efdec tempest-ProjectMemberTests-1601559702 None] Lock "cinder-24856fd6-ed6c-43c2-8c83-4927a9ec9664-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-96b76266-ddea-4919-ad37-e84e8ea0b875 tempest-SnapshotDependencyTests-477965450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1d3a89d5-8f92-4389-a184-c5f59a321158" returned: 0 in 0.417s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-96b76266-ddea-4919-ad37-e84e8ea0b875 tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1d3a89d5-8f92-4389-a184-c5f59a321158 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:42 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1d3a89d5-8f92-4389-a184-c5f59a321158 Nov 06 18:52:42 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7015fa11-00c9-4a59-b7e9-6e8f794efdec tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-24856fd6-ed6c-43c2-8c83-4927a9ec9664" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7015fa11-00c9-4a59-b7e9-6e8f794efdec tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-24856fd6-ed6c-43c2-8c83-4927a9ec9664" acquired by "delete_volume" :: waited 0.016s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:42 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[90965ddd-2639-4b16-8de1-18bc1f9538e1]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7015fa11-00c9-4a59-b7e9-6e8f794efdec tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:42 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664 Nov 06 18:52:42 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:42 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-96b76266-ddea-4919-ad37-e84e8ea0b875 tempest-SnapshotDependencyTests-477965450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-1d3a89d5-8f92-4389-a184-c5f59a321158" returned: 0 in 0.292s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:42 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-96b76266-ddea-4919-ad37-e84e8ea0b875 tempest-SnapshotDependencyTests-477965450 None] Lock "cinder-quobyte-1d3a89d5-8f92-4389-a184-c5f59a321158" released by "delete_volume" :: held 0.792s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:42 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-96b76266-ddea-4919-ad37-e84e8ea0b875 tempest-SnapshotDependencyTests-477965450 None] Created reservations ['f816d9e1-2627-4684-bcfe-9c83ec1dfb50', 'f1426328-e25d-4dc1-b6c7-adc6b9f208d7', '48c4868c-7207-4d04-89c6-6808a4dea769', 'a63bf650-55b8-462b-b136-cf1b30fd703d'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:52:42 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7015fa11-00c9-4a59-b7e9-6e8f794efdec tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664" returned: 0 in 0.451s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7015fa11-00c9-4a59-b7e9-6e8f794efdec tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-96b76266-ddea-4919-ad37-e84e8ea0b875 tempest-SnapshotDependencyTests-477965450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-96b76266-ddea-4919-ad37-e84e8ea0b875 tempest-SnapshotDependencyTests-477965450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-96b76266-ddea-4919-ad37-e84e8ea0b875 tempest-SnapshotDependencyTests-477965450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-96b76266-ddea-4919-ad37-e84e8ea0b875 tempest-SnapshotDependencyTests-477965450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-96b76266-ddea-4919-ad37-e84e8ea0b875 tempest-SnapshotDependencyTests-477965450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:42 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664 Nov 06 18:52:42 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-96b76266-ddea-4919-ad37-e84e8ea0b875 tempest-SnapshotDependencyTests-477965450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:42 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:52:42 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:43 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7015fa11-00c9-4a59-b7e9-6e8f794efdec tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-24856fd6-ed6c-43c2-8c83-4927a9ec9664" returned: 0 in 0.278s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7015fa11-00c9-4a59-b7e9-6e8f794efdec tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-24856fd6-ed6c-43c2-8c83-4927a9ec9664" released by "delete_volume" :: held 0.819s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:43 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-96b76266-ddea-4919-ad37-e84e8ea0b875 tempest-SnapshotDependencyTests-477965450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.298s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:43 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-96b76266-ddea-4919-ad37-e84e8ea0b875 tempest-SnapshotDependencyTests-477965450 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:52:43 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-96b76266-ddea-4919-ad37-e84e8ea0b875 tempest-SnapshotDependencyTests-477965450 None] Deleted volume successfully. Nov 06 18:52:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-96b76266-ddea-4919-ad37-e84e8ea0b875 tempest-SnapshotDependencyTests-477965450 None] Lock "cinder-1d3a89d5-8f92-4389-a184-c5f59a321158-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:43 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-7015fa11-00c9-4a59-b7e9-6e8f794efdec tempest-ProjectMemberTests-1601559702 None] Created reservations ['d333f2d6-561b-4ed5-b90c-20374cd59748', '24cf16b1-7a6d-43e8-9a6c-b4715adb2fdb', 'd10b6dbe-c458-4e67-8990-412cbb0f48f3', '891037ad-6a36-4f27-a385-2f079a937b40'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:52:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7015fa11-00c9-4a59-b7e9-6e8f794efdec tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7015fa11-00c9-4a59-b7e9-6e8f794efdec tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:43 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7015fa11-00c9-4a59-b7e9-6e8f794efdec tempest-ProjectMemberTests-1601559702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:43 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7015fa11-00c9-4a59-b7e9-6e8f794efdec tempest-ProjectMemberTests-1601559702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7015fa11-00c9-4a59-b7e9-6e8f794efdec tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7015fa11-00c9-4a59-b7e9-6e8f794efdec tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:43 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:52:43 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:43 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7015fa11-00c9-4a59-b7e9-6e8f794efdec tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.282s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:43 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-7015fa11-00c9-4a59-b7e9-6e8f794efdec tempest-ProjectMemberTests-1601559702 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:52:43 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-7015fa11-00c9-4a59-b7e9-6e8f794efdec tempest-ProjectMemberTests-1601559702 None] Deleted volume successfully. Nov 06 18:52:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7015fa11-00c9-4a59-b7e9-6e8f794efdec tempest-ProjectMemberTests-1601559702 None] Lock "cinder-24856fd6-ed6c-43c2-8c83-4927a9ec9664-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:43 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:52:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Flow 'volume_create_manager' (11fd8708-d70e-4007-8ade-0f8f62543a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:52:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6297c771-956b-484f-96c3-280df1272dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6297c771-956b-484f-96c3-280df1272dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1127276106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717b2078-8de1-4662-ab4c-c3eceb672592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a2d825e4974b0aa6a265daab4682d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:52:44Z,use_quota=True,user_id='40d648cb4ea342798df1a2c960e9d938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:43 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5980203d-e792-42c6-bc45-032f44fa7e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5980203d-e792-42c6-bc45-032f44fa7e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787e4f22-b6a5-4967-ac5a-a513571e1e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787e4f22-b6a5-4967-ac5a-a513571e1e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '717b2078-8de1-4662-ab4c-c3eceb672592', 'volume_name': 'volume-717b2078-8de1-4662-ab4c-c3eceb672592', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab081dd-3dfc-4d39-8878-bf8f313d791b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab081dd-3dfc-4d39-8878-bf8f313d791b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e550ba0-6c51-408b-9028-b802cb1e335a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:44 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Volume 717b2078-8de1-4662-ab4c-c3eceb672592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-717b2078-8de1-4662-ab4c-c3eceb672592', 'volume_size': 1} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1127276106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717b2078-8de1-4662-ab4c-c3eceb672592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a2d825e4974b0aa6a265daab4682d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:52:44Z,use_quota=True,user_id='40d648cb4ea342798df1a2c960e9d938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Creating volume 717b2078-8de1-4662-ab4c-c3eceb672592 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:52:44 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:44 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592 1073741824 Nov 06 18:52:44 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:44 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592 1073741824" returned: 0 in 0.516s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:44 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592 Nov 06 18:52:44 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:44 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592" returned: 0 in 0.265s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e550ba0-6c51-408b-9028-b802cb1e335a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-717b2078-8de1-4662-ab4c-c3eceb672592', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef4574f-f452-465c-9a46-7964a0e33b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:44 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Volume volume-717b2078-8de1-4662-ab4c-c3eceb672592 (717b2078-8de1-4662-ab4c-c3eceb672592): created successfully Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef4574f-f452-465c-9a46-7964a0e33b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:44 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Flow 'volume_create_manager' (11fd8708-d70e-4007-8ade-0f8f62543a21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:52:44 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-9cc02684-dcf0-43ef-a196-b6248b5e3617 tempest-ProjectMemberTests-1601559702 None] Created volume successfully. Nov 06 18:52:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ec5ae035-ec8c-4a98-a3c2-d7376340766c tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ec5ae035-ec8c-4a98-a3c2-d7376340766c tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:46 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-ec5ae035-ec8c-4a98-a3c2-d7376340766c tempest-ProjectMemberTests-1601559702 None] Creating offline snapshot bb1ec037-8e5c-4def-8403-4526ec3d9639 of volume 717b2078-8de1-4662-ab4c-c3eceb672592 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:52:46 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a97611f-d853-4419-8bad-4b2ae1369ff5]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ec5ae035-ec8c-4a98-a3c2-d7376340766c tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:46 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592 Nov 06 18:52:46 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:46 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ec5ae035-ec8c-4a98-a3c2-d7376340766c tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592" returned: 0 in 0.445s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:46 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ec5ae035-ec8c-4a98-a3c2-d7376340766c tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.bb1ec037-8e5c-4def-8403-4526ec3d9639 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:46 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.bb1ec037-8e5c-4def-8403-4526ec3d9639 1G Nov 06 18:52:46 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:47 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ec5ae035-ec8c-4a98-a3c2-d7376340766c tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.bb1ec037-8e5c-4def-8403-4526ec3d9639 1G" returned: 0 in 0.406s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ec5ae035-ec8c-4a98-a3c2-d7376340766c tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-717b2078-8de1-4662-ab4c-c3eceb672592 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.bb1ec037-8e5c-4def-8403-4526ec3d9639 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:47 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-717b2078-8de1-4662-ab4c-c3eceb672592 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.bb1ec037-8e5c-4def-8403-4526ec3d9639 Nov 06 18:52:47 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:47 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ec5ae035-ec8c-4a98-a3c2-d7376340766c tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-717b2078-8de1-4662-ab4c-c3eceb672592 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.bb1ec037-8e5c-4def-8403-4526ec3d9639" returned: 0 in 0.360s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:47 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-ec5ae035-ec8c-4a98-a3c2-d7376340766c tempest-ProjectMemberTests-1601559702 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.bb1ec037-8e5c-4def-8403-4526ec3d9639 is being set with open permissions: ugo+rw Nov 06 18:52:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ec5ae035-ec8c-4a98-a3c2-d7376340766c tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.bb1ec037-8e5c-4def-8403-4526ec3d9639 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:47 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.bb1ec037-8e5c-4def-8403-4526ec3d9639 Nov 06 18:52:47 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:47 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ec5ae035-ec8c-4a98-a3c2-d7376340766c tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.bb1ec037-8e5c-4def-8403-4526ec3d9639" returned: 0 in 0.258s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ec5ae035-ec8c-4a98-a3c2-d7376340766c tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:47 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.info Nov 06 18:52:47 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:47 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ec5ae035-ec8c-4a98-a3c2-d7376340766c tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.info" returned: 0 in 0.245s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:47 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-ec5ae035-ec8c-4a98-a3c2-d7376340766c tempest-ProjectMemberTests-1601559702 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.info is being set with open permissions: ugo+rw Nov 06 18:52:47 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ec5ae035-ec8c-4a98-a3c2-d7376340766c tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:47 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.info Nov 06 18:52:47 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:48 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-ec5ae035-ec8c-4a98-a3c2-d7376340766c tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.info" returned: 0 in 0.281s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-ec5ae035-ec8c-4a98-a3c2-d7376340766c tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.078s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:48 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-ec5ae035-ec8c-4a98-a3c2-d7376340766c tempest-ProjectMemberTests-1601559702 None] Create snapshot completed successfully Nov 06 18:52:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-bb1ec037-8e5c-4def-8403-4526ec3d9639-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-bb1ec037-8e5c-4def-8403-4526ec3d9639-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-717b2078-8de1-4662-ab4c-c3eceb672592" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-717b2078-8de1-4662-ab4c-c3eceb672592" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-bb1ec037-8e5c-4def-8403-4526ec3d9639" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-bb1ec037-8e5c-4def-8403-4526ec3d9639" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:49 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] Deleting offline snapshot bb1ec037-8e5c-4def-8403-4526ec3d9639 of volume 717b2078-8de1-4662-ab4c-c3eceb672592 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:52:49 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] snapshot_file for this snap is: volume-717b2078-8de1-4662-ab4c-c3eceb672592.bb1ec037-8e5c-4def-8403-4526ec3d9639 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:52:49 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba794b30-43c9-4b9d-9f9f-e7b07c73c1fe]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.bb1ec037-8e5c-4def-8403-4526ec3d9639 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:49 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.bb1ec037-8e5c-4def-8403-4526ec3d9639 Nov 06 18:52:49 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:49 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.bb1ec037-8e5c-4def-8403-4526ec3d9639" returned: 0 in 0.373s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:49 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-717b2078-8de1-4662-ab4c-c3eceb672592(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:52:49 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8640de0-dc4b-43ee-924b-1b7fecdf5562]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:49 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592 Nov 06 18:52:49 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:50 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592" returned: 0 in 0.349s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.bb1ec037-8e5c-4def-8403-4526ec3d9639 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:50 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.bb1ec037-8e5c-4def-8403-4526ec3d9639 Nov 06 18:52:50 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:50 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.bb1ec037-8e5c-4def-8403-4526ec3d9639" returned: 0 in 0.341s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.bb1ec037-8e5c-4def-8403-4526ec3d9639 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:50 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.bb1ec037-8e5c-4def-8403-4526ec3d9639 Nov 06 18:52:50 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:50 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592.bb1ec037-8e5c-4def-8403-4526ec3d9639" returned: 0 in 0.308s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-bb1ec037-8e5c-4def-8403-4526ec3d9639" released by "_delete_snapshot" :: held 1.484s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-717b2078-8de1-4662-ab4c-c3eceb672592" released by "delete_snapshot" :: held 1.505s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:50 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] Created reservations ['fb4c6ba8-3f48-4ca4-b977-390b353fb6ca', 'bbbcf590-3511-40cf-b5f7-e4c568a54dc9', '8e6a78d5-4f7f-436b-96ee-f9e5393ede48', '795431e3-c5ed-4c6a-bd63-f3343e0e38a2'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:52:51 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] Delete snapshot completed successfully. Nov 06 18:52:51 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-5250f31d-2e68-4bb2-b27f-928649e1126b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-bb1ec037-8e5c-4def-8403-4526ec3d9639-delete_snapshot" released by "delete_snapshot" :: held 1.656s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:51 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a0362038-a9b8-4ed9-86ae-1eddd77487e4 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-717b2078-8de1-4662-ab4c-c3eceb672592-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:51 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a0362038-a9b8-4ed9-86ae-1eddd77487e4 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-717b2078-8de1-4662-ab4c-c3eceb672592-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:51 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a0362038-a9b8-4ed9-86ae-1eddd77487e4 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-717b2078-8de1-4662-ab4c-c3eceb672592" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:51 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a0362038-a9b8-4ed9-86ae-1eddd77487e4 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-717b2078-8de1-4662-ab4c-c3eceb672592" acquired by "delete_volume" :: waited 0.021s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:51 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5db14f-2a34-4eee-9cad-a9dd85c2cabe]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a0362038-a9b8-4ed9-86ae-1eddd77487e4 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:51 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592 Nov 06 18:52:51 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:52 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a0362038-a9b8-4ed9-86ae-1eddd77487e4 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592" returned: 0 in 0.380s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a0362038-a9b8-4ed9-86ae-1eddd77487e4 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:52 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592 Nov 06 18:52:52 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:52 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a0362038-a9b8-4ed9-86ae-1eddd77487e4 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-717b2078-8de1-4662-ab4c-c3eceb672592" returned: 0 in 0.249s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a0362038-a9b8-4ed9-86ae-1eddd77487e4 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-717b2078-8de1-4662-ab4c-c3eceb672592" released by "delete_volume" :: held 0.704s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:52 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-a0362038-a9b8-4ed9-86ae-1eddd77487e4 tempest-ProjectMemberTests-1601559702 None] Created reservations ['6e5aa125-8842-4de0-905d-0be542e1a3c0', 'b58be66e-aaaa-48fa-beb6-3eb57c7f29a4', 'd2822273-dbb3-4790-b75a-47b3e6e8d012', 'a4f70713-8545-4564-98db-d2e280e1c9c0'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:52:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a0362038-a9b8-4ed9-86ae-1eddd77487e4 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a0362038-a9b8-4ed9-86ae-1eddd77487e4 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a0362038-a9b8-4ed9-86ae-1eddd77487e4 tempest-ProjectMemberTests-1601559702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a0362038-a9b8-4ed9-86ae-1eddd77487e4 tempest-ProjectMemberTests-1601559702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a0362038-a9b8-4ed9-86ae-1eddd77487e4 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a0362038-a9b8-4ed9-86ae-1eddd77487e4 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:52 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:52:52 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:52 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a0362038-a9b8-4ed9-86ae-1eddd77487e4 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.247s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:52 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-a0362038-a9b8-4ed9-86ae-1eddd77487e4 tempest-ProjectMemberTests-1601559702 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:52:52 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a0362038-a9b8-4ed9-86ae-1eddd77487e4 tempest-ProjectMemberTests-1601559702 None] Deleted volume successfully. Nov 06 18:52:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a0362038-a9b8-4ed9-86ae-1eddd77487e4 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-717b2078-8de1-4662-ab4c-c3eceb672592-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Flow 'volume_create_manager' (cc54cdfd-7c28-430b-aeff-85cf60bebed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877fcdb1-3050-4765-8579-b57f093d5a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877fcdb1-3050-4765-8579-b57f093d5a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2051302401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a7afee-e572-4c9a-8c74-a481a58628aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a2d825e4974b0aa6a265daab4682d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:52:53Z,use_quota=True,user_id='40d648cb4ea342798df1a2c960e9d938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45139031-62cc-4294-afad-81cf76309191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45139031-62cc-4294-afad-81cf76309191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2933fe6-cbb8-459f-8bd9-f0a64bd2fb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2933fe6-cbb8-459f-8bd9-f0a64bd2fb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20a7afee-e572-4c9a-8c74-a481a58628aa', 'volume_name': 'volume-20a7afee-e572-4c9a-8c74-a481a58628aa', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24447444-a2c6-4856-b536-7a6416fdde3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24447444-a2c6-4856-b536-7a6416fdde3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ce2c3f-98c2-48b8-bbd8-94151bb94812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:53 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Volume 20a7afee-e572-4c9a-8c74-a481a58628aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20a7afee-e572-4c9a-8c74-a481a58628aa', 'volume_size': 1} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2051302401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a7afee-e572-4c9a-8c74-a481a58628aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a2d825e4974b0aa6a265daab4682d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:52:53Z,use_quota=True,user_id='40d648cb4ea342798df1a2c960e9d938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Creating volume 20a7afee-e572-4c9a-8c74-a481a58628aa {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:52:53 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:53 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa 1073741824 Nov 06 18:52:53 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:53 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa 1073741824" returned: 0 in 0.435s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:53 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa Nov 06 18:52:53 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:53 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa" returned: 0 in 0.242s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ce2c3f-98c2-48b8-bbd8-94151bb94812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20a7afee-e572-4c9a-8c74-a481a58628aa', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdd87fb-93ac-4685-ba53-96d91f2fc77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:52:53 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Volume volume-20a7afee-e572-4c9a-8c74-a481a58628aa (20a7afee-e572-4c9a-8c74-a481a58628aa): created successfully Nov 06 18:52:53 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdd87fb-93ac-4685-ba53-96d91f2fc77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:52:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Flow 'volume_create_manager' (cc54cdfd-7c28-430b-aeff-85cf60bebed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:52:54 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-571b14b6-08a4-44b7-b341-e6a2f623afb5 tempest-ProjectMemberTests-1601559702 None] Created volume successfully. Nov 06 18:52:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-448a4f15-e6a8-4b65-8740-d79ee30ef100 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-448a4f15-e6a8-4b65-8740-d79ee30ef100 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-448a4f15-e6a8-4b65-8740-d79ee30ef100 tempest-ProjectMemberTests-1601559702 None] Creating offline snapshot 53308a63-7d34-467e-9abd-f4a5c104c0c0 of volume 20a7afee-e572-4c9a-8c74-a481a58628aa {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:52:54 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[749ff11c-821a-474a-89c8-95fb18e8329c]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-448a4f15-e6a8-4b65-8740-d79ee30ef100 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:54 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa Nov 06 18:52:54 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:54 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-448a4f15-e6a8-4b65-8740-d79ee30ef100 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa" returned: 0 in 0.361s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-448a4f15-e6a8-4b65-8740-d79ee30ef100 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.53308a63-7d34-467e-9abd-f4a5c104c0c0 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:54 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.53308a63-7d34-467e-9abd-f4a5c104c0c0 1G Nov 06 18:52:54 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:55 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-448a4f15-e6a8-4b65-8740-d79ee30ef100 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.53308a63-7d34-467e-9abd-f4a5c104c0c0 1G" returned: 0 in 0.376s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-448a4f15-e6a8-4b65-8740-d79ee30ef100 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a7afee-e572-4c9a-8c74-a481a58628aa -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.53308a63-7d34-467e-9abd-f4a5c104c0c0 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:55 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a7afee-e572-4c9a-8c74-a481a58628aa -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.53308a63-7d34-467e-9abd-f4a5c104c0c0 Nov 06 18:52:55 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:55 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-448a4f15-e6a8-4b65-8740-d79ee30ef100 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a7afee-e572-4c9a-8c74-a481a58628aa -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.53308a63-7d34-467e-9abd-f4a5c104c0c0" returned: 0 in 0.286s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:55 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-448a4f15-e6a8-4b65-8740-d79ee30ef100 tempest-ProjectMemberTests-1601559702 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.53308a63-7d34-467e-9abd-f4a5c104c0c0 is being set with open permissions: ugo+rw Nov 06 18:52:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-448a4f15-e6a8-4b65-8740-d79ee30ef100 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.53308a63-7d34-467e-9abd-f4a5c104c0c0 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:55 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.53308a63-7d34-467e-9abd-f4a5c104c0c0 Nov 06 18:52:55 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:55 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-448a4f15-e6a8-4b65-8740-d79ee30ef100 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.53308a63-7d34-467e-9abd-f4a5c104c0c0" returned: 0 in 0.235s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-448a4f15-e6a8-4b65-8740-d79ee30ef100 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:55 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.info Nov 06 18:52:55 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:55 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-448a4f15-e6a8-4b65-8740-d79ee30ef100 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.info" returned: 0 in 0.250s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:55 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-448a4f15-e6a8-4b65-8740-d79ee30ef100 tempest-ProjectMemberTests-1601559702 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.info is being set with open permissions: ugo+rw Nov 06 18:52:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-448a4f15-e6a8-4b65-8740-d79ee30ef100 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:55 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.info Nov 06 18:52:55 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:56 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-448a4f15-e6a8-4b65-8740-d79ee30ef100 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.info" returned: 0 in 0.248s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-448a4f15-e6a8-4b65-8740-d79ee30ef100 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.831s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:56 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-448a4f15-e6a8-4b65-8740-d79ee30ef100 tempest-ProjectMemberTests-1601559702 None] Create snapshot completed successfully Nov 06 18:52:56 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-53308a63-7d34-467e-9abd-f4a5c104c0c0-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:56 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-53308a63-7d34-467e-9abd-f4a5c104c0c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:56 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-20a7afee-e572-4c9a-8c74-a481a58628aa" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:56 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-20a7afee-e572-4c9a-8c74-a481a58628aa" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:56 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-53308a63-7d34-467e-9abd-f4a5c104c0c0" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:56 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-53308a63-7d34-467e-9abd-f4a5c104c0c0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:56 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] Deleting offline snapshot 53308a63-7d34-467e-9abd-f4a5c104c0c0 of volume 20a7afee-e572-4c9a-8c74-a481a58628aa {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:52:56 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] snapshot_file for this snap is: volume-20a7afee-e572-4c9a-8c74-a481a58628aa.53308a63-7d34-467e-9abd-f4a5c104c0c0 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:52:56 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[168f47b0-8f03-4bb8-a77c-b0e337f613b8]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.53308a63-7d34-467e-9abd-f4a5c104c0c0 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:56 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.53308a63-7d34-467e-9abd-f4a5c104c0c0 Nov 06 18:52:56 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:56 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.53308a63-7d34-467e-9abd-f4a5c104c0c0" returned: 0 in 0.344s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:56 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20a7afee-e572-4c9a-8c74-a481a58628aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:52:56 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a1fb38-eacf-4e32-9fc0-27b12bba20aa]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:57 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa Nov 06 18:52:57 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:57 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa" returned: 0 in 0.346s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.53308a63-7d34-467e-9abd-f4a5c104c0c0 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:57 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.53308a63-7d34-467e-9abd-f4a5c104c0c0 Nov 06 18:52:57 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:57 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.53308a63-7d34-467e-9abd-f4a5c104c0c0" returned: 0 in 0.321s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.53308a63-7d34-467e-9abd-f4a5c104c0c0 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:57 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.53308a63-7d34-467e-9abd-f4a5c104c0c0 Nov 06 18:52:57 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:57 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa.53308a63-7d34-467e-9abd-f4a5c104c0c0" returned: 0 in 0.248s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:57 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-53308a63-7d34-467e-9abd-f4a5c104c0c0" released by "_delete_snapshot" :: held 1.350s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:57 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-20a7afee-e572-4c9a-8c74-a481a58628aa" released by "delete_snapshot" :: held 1.371s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:57 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] Created reservations ['272ca793-83a5-4063-8cdc-df9c50ce4551', 'b49b6645-c552-4972-b3d8-6724a9c33f54', '31779040-8f6b-4087-84bc-0c90e9d73110', '1b8ecb9d-d230-4656-bd05-de7ca42b13f6'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:52:57 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] Delete snapshot completed successfully. Nov 06 18:52:57 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-9681bdcd-ea89-4d40-a4f8-67003266ca8b tempest-ProjectMemberTests-1601559702 None] Lock "cinder-53308a63-7d34-467e-9abd-f4a5c104c0c0-delete_snapshot" released by "delete_snapshot" :: held 1.493s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:58 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-23fd1427-9291-4c3a-9350-5aa23d0234e5 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-20a7afee-e572-4c9a-8c74-a481a58628aa-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:58 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-23fd1427-9291-4c3a-9350-5aa23d0234e5 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-20a7afee-e572-4c9a-8c74-a481a58628aa-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:58 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-23fd1427-9291-4c3a-9350-5aa23d0234e5 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-20a7afee-e572-4c9a-8c74-a481a58628aa" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:52:58 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-23fd1427-9291-4c3a-9350-5aa23d0234e5 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-20a7afee-e572-4c9a-8c74-a481a58628aa" acquired by "delete_volume" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:52:58 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa294308-1a6e-407c-89ea-bbe2a7990052]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:52:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-23fd1427-9291-4c3a-9350-5aa23d0234e5 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:58 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa Nov 06 18:52:58 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:59 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-23fd1427-9291-4c3a-9350-5aa23d0234e5 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa" returned: 0 in 0.363s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-23fd1427-9291-4c3a-9350-5aa23d0234e5 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:59 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa Nov 06 18:52:59 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:59 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-23fd1427-9291-4c3a-9350-5aa23d0234e5 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-20a7afee-e572-4c9a-8c74-a481a58628aa" returned: 0 in 0.239s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:59 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-23fd1427-9291-4c3a-9350-5aa23d0234e5 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-20a7afee-e572-4c9a-8c74-a481a58628aa" released by "delete_volume" :: held 0.667s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:52:59 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-23fd1427-9291-4c3a-9350-5aa23d0234e5 tempest-ProjectMemberTests-1601559702 None] Created reservations ['c44148c4-09c2-48aa-b28c-a048fc624466', '336df2b6-866a-41da-8c35-09653b08d084', '0807fdb1-060a-4215-9d6c-4c3c380e960c', 'b1767de3-0791-48cb-9daf-2b14afe9c4a4'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:52:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-23fd1427-9291-4c3a-9350-5aa23d0234e5 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:52:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-23fd1427-9291-4c3a-9350-5aa23d0234e5 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:52:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-23fd1427-9291-4c3a-9350-5aa23d0234e5 tempest-ProjectMemberTests-1601559702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:52:59 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-23fd1427-9291-4c3a-9350-5aa23d0234e5 tempest-ProjectMemberTests-1601559702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:52:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-23fd1427-9291-4c3a-9350-5aa23d0234e5 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:52:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-23fd1427-9291-4c3a-9350-5aa23d0234e5 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:52:59 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:52:59 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:52:59 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Nov 06 18:52:59 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-23fd1427-9291-4c3a-9350-5aa23d0234e5 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.250s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:52:59 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-23fd1427-9291-4c3a-9350-5aa23d0234e5 tempest-ProjectMemberTests-1601559702 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:52:59 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-23fd1427-9291-4c3a-9350-5aa23d0234e5 tempest-ProjectMemberTests-1601559702 None] Deleted volume successfully. Nov 06 18:52:59 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-23fd1427-9291-4c3a-9350-5aa23d0234e5 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-20a7afee-e572-4c9a-8c74-a481a58628aa-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Flow 'volume_create_manager' (d8958f86-08c0-4c24-92bf-96a7d08fe993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58afe61-8c04-4e40-93b4-012f0d70e433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58afe61-8c04-4e40-93b4-012f0d70e433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1425558195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8066bb8a-df1d-4afa-b592-609331fedc16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a2d825e4974b0aa6a265daab4682d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:53:00Z,use_quota=True,user_id='40d648cb4ea342798df1a2c960e9d938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f86d52-b691-412b-9d63-63e99de01791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f86d52-b691-412b-9d63-63e99de01791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a7dbca-574b-4898-a6d5-df84c1ad492a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a7dbca-574b-4898-a6d5-df84c1ad492a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8066bb8a-df1d-4afa-b592-609331fedc16', 'volume_name': 'volume-8066bb8a-df1d-4afa-b592-609331fedc16', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (340005cb-1524-425c-a612-f032e7b71396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (340005cb-1524-425c-a612-f032e7b71396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8d6520-84fe-49d3-bf56-b974edffdedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:00 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Volume 8066bb8a-df1d-4afa-b592-609331fedc16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8066bb8a-df1d-4afa-b592-609331fedc16', 'volume_size': 1} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1425558195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8066bb8a-df1d-4afa-b592-609331fedc16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a2d825e4974b0aa6a265daab4682d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:53:00Z,use_quota=True,user_id='40d648cb4ea342798df1a2c960e9d938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Creating volume 8066bb8a-df1d-4afa-b592-609331fedc16 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:53:00 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:00 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16 1073741824 Nov 06 18:53:00 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:00 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16 1073741824" returned: 0 in 0.416s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:00 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16 Nov 06 18:53:00 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:00 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16" returned: 0 in 0.243s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8d6520-84fe-49d3-bf56-b974edffdedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8066bb8a-df1d-4afa-b592-609331fedc16', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18219968-51d1-4c3d-9041-2c5e9656c42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:00 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Volume volume-8066bb8a-df1d-4afa-b592-609331fedc16 (8066bb8a-df1d-4afa-b592-609331fedc16): created successfully Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18219968-51d1-4c3d-9041-2c5e9656c42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:00 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Flow 'volume_create_manager' (d8958f86-08c0-4c24-92bf-96a7d08fe993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:53:01 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-dbb32291-d07f-4f52-ac1f-c6ba2f3aff1e tempest-ProjectMemberTests-1601559702 None] Created volume successfully. Nov 06 18:53:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e0b971a2-3c9b-4192-aff5-b7d7eef3529b tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e0b971a2-3c9b-4192-aff5-b7d7eef3529b tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:01 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-e0b971a2-3c9b-4192-aff5-b7d7eef3529b tempest-ProjectMemberTests-1601559702 None] Creating offline snapshot 614dc5f0-cd18-4fb0-8a56-cbb653b9dce6 of volume 8066bb8a-df1d-4afa-b592-609331fedc16 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:53:01 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce1c57a-b9a7-45fb-af8b-45e2f0bd5a42]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e0b971a2-3c9b-4192-aff5-b7d7eef3529b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:01 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16 Nov 06 18:53:01 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:01 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e0b971a2-3c9b-4192-aff5-b7d7eef3529b tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16" returned: 0 in 0.356s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:01 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e0b971a2-3c9b-4192-aff5-b7d7eef3529b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.614dc5f0-cd18-4fb0-8a56-cbb653b9dce6 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:01 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.614dc5f0-cd18-4fb0-8a56-cbb653b9dce6 1G Nov 06 18:53:01 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:02 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e0b971a2-3c9b-4192-aff5-b7d7eef3529b tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.614dc5f0-cd18-4fb0-8a56-cbb653b9dce6 1G" returned: 0 in 0.409s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e0b971a2-3c9b-4192-aff5-b7d7eef3529b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8066bb8a-df1d-4afa-b592-609331fedc16 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.614dc5f0-cd18-4fb0-8a56-cbb653b9dce6 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:02 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8066bb8a-df1d-4afa-b592-609331fedc16 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.614dc5f0-cd18-4fb0-8a56-cbb653b9dce6 Nov 06 18:53:02 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:02 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e0b971a2-3c9b-4192-aff5-b7d7eef3529b tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8066bb8a-df1d-4afa-b592-609331fedc16 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.614dc5f0-cd18-4fb0-8a56-cbb653b9dce6" returned: 0 in 0.293s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:02 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-e0b971a2-3c9b-4192-aff5-b7d7eef3529b tempest-ProjectMemberTests-1601559702 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.614dc5f0-cd18-4fb0-8a56-cbb653b9dce6 is being set with open permissions: ugo+rw Nov 06 18:53:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e0b971a2-3c9b-4192-aff5-b7d7eef3529b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.614dc5f0-cd18-4fb0-8a56-cbb653b9dce6 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:02 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.614dc5f0-cd18-4fb0-8a56-cbb653b9dce6 Nov 06 18:53:02 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:02 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e0b971a2-3c9b-4192-aff5-b7d7eef3529b tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.614dc5f0-cd18-4fb0-8a56-cbb653b9dce6" returned: 0 in 0.254s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e0b971a2-3c9b-4192-aff5-b7d7eef3529b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:02 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.info Nov 06 18:53:02 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:02 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e0b971a2-3c9b-4192-aff5-b7d7eef3529b tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.info" returned: 0 in 0.251s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:02 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-e0b971a2-3c9b-4192-aff5-b7d7eef3529b tempest-ProjectMemberTests-1601559702 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.info is being set with open permissions: ugo+rw Nov 06 18:53:02 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e0b971a2-3c9b-4192-aff5-b7d7eef3529b tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:02 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.info Nov 06 18:53:02 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:03 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e0b971a2-3c9b-4192-aff5-b7d7eef3529b tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.info" returned: 0 in 0.240s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e0b971a2-3c9b-4192-aff5-b7d7eef3529b tempest-ProjectMemberTests-1601559702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.883s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:03 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-e0b971a2-3c9b-4192-aff5-b7d7eef3529b tempest-ProjectMemberTests-1601559702 None] Create snapshot completed successfully Nov 06 18:53:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-614dc5f0-cd18-4fb0-8a56-cbb653b9dce6-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-614dc5f0-cd18-4fb0-8a56-cbb653b9dce6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-8066bb8a-df1d-4afa-b592-609331fedc16" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-8066bb8a-df1d-4afa-b592-609331fedc16" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-614dc5f0-cd18-4fb0-8a56-cbb653b9dce6" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:03 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-614dc5f0-cd18-4fb0-8a56-cbb653b9dce6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] Deleting offline snapshot 614dc5f0-cd18-4fb0-8a56-cbb653b9dce6 of volume 8066bb8a-df1d-4afa-b592-609331fedc16 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:53:03 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] snapshot_file for this snap is: volume-8066bb8a-df1d-4afa-b592-609331fedc16.614dc5f0-cd18-4fb0-8a56-cbb653b9dce6 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:53:03 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[419cffc6-8d80-40e6-a04f-0bec5bb4af98]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:03 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.614dc5f0-cd18-4fb0-8a56-cbb653b9dce6 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:03 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.614dc5f0-cd18-4fb0-8a56-cbb653b9dce6 Nov 06 18:53:03 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:04 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.614dc5f0-cd18-4fb0-8a56-cbb653b9dce6" returned: 0 in 0.358s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:04 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8066bb8a-df1d-4afa-b592-609331fedc16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:53:04 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[016990ad-b7bc-439f-850d-43017d2bc48d]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:04 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16 Nov 06 18:53:04 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:04 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16" returned: 0 in 0.351s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.614dc5f0-cd18-4fb0-8a56-cbb653b9dce6 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:04 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.614dc5f0-cd18-4fb0-8a56-cbb653b9dce6 Nov 06 18:53:04 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:04 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.614dc5f0-cd18-4fb0-8a56-cbb653b9dce6" returned: 0 in 0.334s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.614dc5f0-cd18-4fb0-8a56-cbb653b9dce6 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:04 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.614dc5f0-cd18-4fb0-8a56-cbb653b9dce6 Nov 06 18:53:04 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:04 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:04 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16.614dc5f0-cd18-4fb0-8a56-cbb653b9dce6" returned: 0 in 0.240s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:04 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-614dc5f0-cd18-4fb0-8a56-cbb653b9dce6" released by "_delete_snapshot" :: held 1.378s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:05 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-8066bb8a-df1d-4afa-b592-609331fedc16" released by "delete_snapshot" :: held 1.399s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:05 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=130,cinder:INSERT=46,cinder:UPDATE=157,cinder:DELETE=15 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:53:05 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=130,cinder:UPDATE=181,cinder:DELETE=14,cinder:INSERT=44 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:53:05 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] Created reservations ['ac2a080a-5591-460d-a70a-3a01e65973bd', '1eb9f840-a15b-4c80-b0f0-6feeb3bc67c8', 'ed9cde3b-add2-4989-ab3d-216a2e86d207', '73074b44-53a4-4595-85e0-033110811689'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:53:05 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] Delete snapshot completed successfully. Nov 06 18:53:05 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-f204caa6-2e40-42a5-ab7d-77ce9af7a4d4 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-614dc5f0-cd18-4fb0-8a56-cbb653b9dce6-delete_snapshot" released by "delete_snapshot" :: held 1.536s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:05 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6605e668-9b2f-4146-9f08-11c77019ccb0 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-8066bb8a-df1d-4afa-b592-609331fedc16-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:05 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6605e668-9b2f-4146-9f08-11c77019ccb0 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-8066bb8a-df1d-4afa-b592-609331fedc16-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:05 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6605e668-9b2f-4146-9f08-11c77019ccb0 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "cinder-quobyte-8066bb8a-df1d-4afa-b592-609331fedc16" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:05 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6605e668-9b2f-4146-9f08-11c77019ccb0 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-8066bb8a-df1d-4afa-b592-609331fedc16" acquired by "delete_volume" :: waited 0.018s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:05 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5ffcf0-a9ba-457d-b367-603c02ec72c2]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:05 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6605e668-9b2f-4146-9f08-11c77019ccb0 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:05 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16 Nov 06 18:53:05 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:06 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6605e668-9b2f-4146-9f08-11c77019ccb0 tempest-ProjectMemberTests-1601559702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16" returned: 0 in 0.351s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6605e668-9b2f-4146-9f08-11c77019ccb0 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:06 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16 Nov 06 18:53:06 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:06 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6605e668-9b2f-4146-9f08-11c77019ccb0 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-8066bb8a-df1d-4afa-b592-609331fedc16" returned: 0 in 0.237s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6605e668-9b2f-4146-9f08-11c77019ccb0 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-quobyte-8066bb8a-df1d-4afa-b592-609331fedc16" released by "delete_volume" :: held 0.646s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:06 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-6605e668-9b2f-4146-9f08-11c77019ccb0 tempest-ProjectMemberTests-1601559702 None] Created reservations ['90fa331a-c5b4-4074-8705-99c9ec0e5327', '3df15a43-e0d0-4e84-ab40-6b905971dae9', '7dc4cc0d-d250-4d2d-805f-612acfba445a', '61bbf7c9-ed1d-4717-8128-7a8963f9105a'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:53:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6605e668-9b2f-4146-9f08-11c77019ccb0 tempest-ProjectMemberTests-1601559702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6605e668-9b2f-4146-9f08-11c77019ccb0 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6605e668-9b2f-4146-9f08-11c77019ccb0 tempest-ProjectMemberTests-1601559702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:06 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-6605e668-9b2f-4146-9f08-11c77019ccb0 tempest-ProjectMemberTests-1601559702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-6605e668-9b2f-4146-9f08-11c77019ccb0 tempest-ProjectMemberTests-1601559702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6605e668-9b2f-4146-9f08-11c77019ccb0 tempest-ProjectMemberTests-1601559702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:06 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:53:06 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:06 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:06 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-6605e668-9b2f-4146-9f08-11c77019ccb0 tempest-ProjectMemberTests-1601559702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.238s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:06 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-6605e668-9b2f-4146-9f08-11c77019ccb0 tempest-ProjectMemberTests-1601559702 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:53:06 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-6605e668-9b2f-4146-9f08-11c77019ccb0 tempest-ProjectMemberTests-1601559702 None] Deleted volume successfully. Nov 06 18:53:06 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-6605e668-9b2f-4146-9f08-11c77019ccb0 tempest-ProjectMemberTests-1601559702 None] Lock "cinder-8066bb8a-df1d-4afa-b592-609331fedc16-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Flow 'volume_create_manager' (1cfe1f6a-3aa4-46bb-9aea-5c1682e72cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8381b5d5-9bad-4dce-ab5d-25991be4e8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8381b5d5-9bad-4dce-ab5d-25991be4e8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259889163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2671262bfcfe4f56b2546faeeadbf2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:53:10Z,use_quota=True,user_id='d6304724b1574356866724b36417c779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce80818d-8ff4-46ff-8be5-75e12da72cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce80818d-8ff4-46ff-8be5-75e12da72cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf8d0b7d-5b9f-4a42-a91b-9cd9ceb2f62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf8d0b7d-5b9f-4a42-a91b-9cd9ceb2f62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc', 'volume_name': 'volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f214f52c-96bd-4a6b-b8ed-e249c6d3b8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f214f52c-96bd-4a6b-b8ed-e249c6d3b8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9680dc-2b6b-458a-8c4c-b20e68473f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:10 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Volume 079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc', 'volume_size': 1} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259889163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2671262bfcfe4f56b2546faeeadbf2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:53:10Z,use_quota=True,user_id='d6304724b1574356866724b36417c779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Creating volume 079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:53:10 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:10 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc 1073741824 Nov 06 18:53:10 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:10 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc 1073741824" returned: 0 in 0.411s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:10 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:10 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc Nov 06 18:53:10 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:11 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc" returned: 0 in 0.244s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:53:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9680dc-2b6b-458a-8c4c-b20e68473f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a50df7-8268-4da5-9e90-13ff8612142d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:11 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Volume volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc (079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc): created successfully Nov 06 18:53:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a50df7-8268-4da5-9e90-13ff8612142d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:11 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Flow 'volume_create_manager' (1cfe1f6a-3aa4-46bb-9aea-5c1682e72cbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:53:11 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-369b7077-27f7-422b-b583-8aea8ca21198 tempest-ProjectReaderTests-128439654 None] Created volume successfully. Nov 06 18:53:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d101d1a7-b70a-431a-86cc-3de34f6a10d1 tempest-ProjectReaderTests-128439654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d101d1a7-b70a-431a-86cc-3de34f6a10d1 tempest-ProjectReaderTests-128439654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:11 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-d101d1a7-b70a-431a-86cc-3de34f6a10d1 tempest-ProjectReaderTests-128439654 None] Creating offline snapshot 13f949d0-bcd0-486d-81cb-c8ae172521a7 of volume 079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:53:11 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d29f4b-3eb8-45b0-b0d3-ad7a69f5337c]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d101d1a7-b70a-431a-86cc-3de34f6a10d1 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:11 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc Nov 06 18:53:11 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:11 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d101d1a7-b70a-431a-86cc-3de34f6a10d1 tempest-ProjectReaderTests-128439654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc" returned: 0 in 0.348s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:11 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d101d1a7-b70a-431a-86cc-3de34f6a10d1 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.13f949d0-bcd0-486d-81cb-c8ae172521a7 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:11 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.13f949d0-bcd0-486d-81cb-c8ae172521a7 1G Nov 06 18:53:11 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:12 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d101d1a7-b70a-431a-86cc-3de34f6a10d1 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.13f949d0-bcd0-486d-81cb-c8ae172521a7 1G" returned: 0 in 0.400s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d101d1a7-b70a-431a-86cc-3de34f6a10d1 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.13f949d0-bcd0-486d-81cb-c8ae172521a7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:12 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.13f949d0-bcd0-486d-81cb-c8ae172521a7 Nov 06 18:53:12 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:12 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d101d1a7-b70a-431a-86cc-3de34f6a10d1 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.13f949d0-bcd0-486d-81cb-c8ae172521a7" returned: 0 in 0.302s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:12 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-d101d1a7-b70a-431a-86cc-3de34f6a10d1 tempest-ProjectReaderTests-128439654 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.13f949d0-bcd0-486d-81cb-c8ae172521a7 is being set with open permissions: ugo+rw Nov 06 18:53:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d101d1a7-b70a-431a-86cc-3de34f6a10d1 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.13f949d0-bcd0-486d-81cb-c8ae172521a7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:12 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.13f949d0-bcd0-486d-81cb-c8ae172521a7 Nov 06 18:53:12 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:12 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d101d1a7-b70a-431a-86cc-3de34f6a10d1 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.13f949d0-bcd0-486d-81cb-c8ae172521a7" returned: 0 in 0.232s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:12 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d101d1a7-b70a-431a-86cc-3de34f6a10d1 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:12 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.info Nov 06 18:53:12 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:13 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d101d1a7-b70a-431a-86cc-3de34f6a10d1 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.info" returned: 0 in 0.246s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:13 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-d101d1a7-b70a-431a-86cc-3de34f6a10d1 tempest-ProjectReaderTests-128439654 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.info is being set with open permissions: ugo+rw Nov 06 18:53:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d101d1a7-b70a-431a-86cc-3de34f6a10d1 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:13 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.info Nov 06 18:53:13 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:13 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-d101d1a7-b70a-431a-86cc-3de34f6a10d1 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.info" returned: 0 in 0.239s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-d101d1a7-b70a-431a-86cc-3de34f6a10d1 tempest-ProjectReaderTests-128439654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.852s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:13 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-d101d1a7-b70a-431a-86cc-3de34f6a10d1 tempest-ProjectReaderTests-128439654 None] Create snapshot completed successfully Nov 06 18:53:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-13f949d0-bcd0-486d-81cb-c8ae172521a7-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] Lock "cinder-13f949d0-bcd0-486d-81cb-c8ae172521a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-quobyte-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-quobyte-13f949d0-bcd0-486d-81cb-c8ae172521a7" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:13 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-13f949d0-bcd0-486d-81cb-c8ae172521a7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] Deleting offline snapshot 13f949d0-bcd0-486d-81cb-c8ae172521a7 of volume 079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:53:13 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] snapshot_file for this snap is: volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.13f949d0-bcd0-486d-81cb-c8ae172521a7 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:53:13 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16d1d4c-1007-405b-971b-c6c5265c9e98]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:13 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.13f949d0-bcd0-486d-81cb-c8ae172521a7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:14 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.13f949d0-bcd0-486d-81cb-c8ae172521a7 Nov 06 18:53:14 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:14 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.13f949d0-bcd0-486d-81cb-c8ae172521a7" returned: 0 in 0.355s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:14 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:53:14 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5fa353-a0c5-4445-9963-3d25a549f70f]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:14 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc Nov 06 18:53:14 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:14 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc" returned: 0 in 0.364s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.13f949d0-bcd0-486d-81cb-c8ae172521a7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:14 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.13f949d0-bcd0-486d-81cb-c8ae172521a7 Nov 06 18:53:14 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:14 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.13f949d0-bcd0-486d-81cb-c8ae172521a7" returned: 0 in 0.318s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:14 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.13f949d0-bcd0-486d-81cb-c8ae172521a7 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:15 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.13f949d0-bcd0-486d-81cb-c8ae172521a7 Nov 06 18:53:15 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:15 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:15 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc.13f949d0-bcd0-486d-81cb-c8ae172521a7" returned: 0 in 0.245s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-13f949d0-bcd0-486d-81cb-c8ae172521a7" released by "_delete_snapshot" :: held 1.389s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc" released by "delete_snapshot" :: held 1.409s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:15 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] Created reservations ['96956461-7472-4cde-b6d7-cefda53c0bec', 'ac1032e2-f30d-4f60-8923-3d64f884aab2', '0ec24376-6c9c-4bd9-8562-88dd33af0fa2', 'daae6477-e4e9-4398-89ed-5d1ad9a0c4b4'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:53:15 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] Delete snapshot completed successfully. Nov 06 18:53:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3382cc6d-b06d-4c2e-8094-48d107c6a3b2 tempest-ProjectReaderTests-128439654 None] Lock "cinder-13f949d0-bcd0-486d-81cb-c8ae172521a7-delete_snapshot" released by "delete_snapshot" :: held 1.535s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-eec3000d-224b-4d76-82cf-6f9302e895bb tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:15 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-eec3000d-224b-4d76-82cf-6f9302e895bb tempest-ProjectReaderTests-128439654 None] Lock "cinder-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-eec3000d-224b-4d76-82cf-6f9302e895bb tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-quobyte-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-eec3000d-224b-4d76-82cf-6f9302e895bb tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc" acquired by "delete_volume" :: waited 0.014s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:16 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4ccd3c-1598-42f0-8718-ad436dc14254]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eec3000d-224b-4d76-82cf-6f9302e895bb tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:16 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc Nov 06 18:53:16 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:16 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eec3000d-224b-4d76-82cf-6f9302e895bb tempest-ProjectReaderTests-128439654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc" returned: 0 in 0.351s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eec3000d-224b-4d76-82cf-6f9302e895bb tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:16 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc Nov 06 18:53:16 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:16 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eec3000d-224b-4d76-82cf-6f9302e895bb tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc" returned: 0 in 0.253s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:16 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-eec3000d-224b-4d76-82cf-6f9302e895bb tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc" released by "delete_volume" :: held 0.664s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:16 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-eec3000d-224b-4d76-82cf-6f9302e895bb tempest-ProjectReaderTests-128439654 None] Created reservations ['7be66038-ec92-444d-a05b-b39b938bba2d', 'e232b306-64c6-40d9-befc-2dea05ccbe4c', 'adef7a8e-88e4-4f0a-be92-9898993193a9', '24afb8cd-0a8b-4b77-961d-c29cfb18355b'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:53:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eec3000d-224b-4d76-82cf-6f9302e895bb tempest-ProjectReaderTests-128439654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eec3000d-224b-4d76-82cf-6f9302e895bb tempest-ProjectReaderTests-128439654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-eec3000d-224b-4d76-82cf-6f9302e895bb tempest-ProjectReaderTests-128439654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:16 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-eec3000d-224b-4d76-82cf-6f9302e895bb tempest-ProjectReaderTests-128439654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-eec3000d-224b-4d76-82cf-6f9302e895bb tempest-ProjectReaderTests-128439654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:16 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eec3000d-224b-4d76-82cf-6f9302e895bb tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:16 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:53:16 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:17 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-eec3000d-224b-4d76-82cf-6f9302e895bb tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.238s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-eec3000d-224b-4d76-82cf-6f9302e895bb tempest-ProjectReaderTests-128439654 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:53:17 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-eec3000d-224b-4d76-82cf-6f9302e895bb tempest-ProjectReaderTests-128439654 None] Deleted volume successfully. Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-eec3000d-224b-4d76-82cf-6f9302e895bb tempest-ProjectReaderTests-128439654 None] Lock "cinder-079ed672-ea6c-4afb-9eaa-1ee98ee8a7cc-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Flow 'volume_create_manager' (c5aaa707-378a-42ba-8eae-961419d3af4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea7ef7d-15e5-4d58-8f07-f6b287cca000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea7ef7d-15e5-4d58-8f07-f6b287cca000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1190643264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a45d4f-f4e2-403f-87dc-74686c2db575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2671262bfcfe4f56b2546faeeadbf2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:53:17Z,use_quota=True,user_id='d6304724b1574356866724b36417c779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5fa104-9af1-4f4b-a18c-5781bc95af4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5fa104-9af1-4f4b-a18c-5781bc95af4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92d6797c-a5ad-4a88-b885-adff745a288a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92d6797c-a5ad-4a88-b885-adff745a288a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6a45d4f-f4e2-403f-87dc-74686c2db575', 'volume_name': 'volume-c6a45d4f-f4e2-403f-87dc-74686c2db575', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f127e62c-4b88-4338-980c-93fc73d106fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f127e62c-4b88-4338-980c-93fc73d106fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a984188-b1bc-4aae-b611-18bb2dfcaeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:17 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Volume c6a45d4f-f4e2-403f-87dc-74686c2db575: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6a45d4f-f4e2-403f-87dc-74686c2db575', 'volume_size': 1} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1190643264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a45d4f-f4e2-403f-87dc-74686c2db575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2671262bfcfe4f56b2546faeeadbf2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:53:17Z,use_quota=True,user_id='d6304724b1574356866724b36417c779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Creating volume c6a45d4f-f4e2-403f-87dc-74686c2db575 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:53:17 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:53:17 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:17 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575 1073741824 Nov 06 18:53:17 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:18 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575 1073741824" returned: 0 in 0.422s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:18 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575 Nov 06 18:53:18 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:18 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575" returned: 0 in 0.243s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:53:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a984188-b1bc-4aae-b611-18bb2dfcaeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6a45d4f-f4e2-403f-87dc-74686c2db575', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (809eb2d7-1812-483f-b67e-e6ecdafec22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:18 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Volume volume-c6a45d4f-f4e2-403f-87dc-74686c2db575 (c6a45d4f-f4e2-403f-87dc-74686c2db575): created successfully Nov 06 18:53:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (809eb2d7-1812-483f-b67e-e6ecdafec22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:18 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Flow 'volume_create_manager' (c5aaa707-378a-42ba-8eae-961419d3af4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:53:18 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-8d4f332b-93d7-45e2-bdfe-38ef74df563a tempest-ProjectReaderTests-128439654 None] Created volume successfully. Nov 06 18:53:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2a92cdfc-c59f-4d71-bd85-cabeee06dc74 tempest-ProjectReaderTests-128439654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2a92cdfc-c59f-4d71-bd85-cabeee06dc74 tempest-ProjectReaderTests-128439654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:18 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-2a92cdfc-c59f-4d71-bd85-cabeee06dc74 tempest-ProjectReaderTests-128439654 None] Creating offline snapshot 9a0c747e-96dc-4f72-8e0a-f39eaef430d2 of volume c6a45d4f-f4e2-403f-87dc-74686c2db575 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:53:18 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[13146491-3cec-4e8b-a94b-72f00d344114]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:18 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2a92cdfc-c59f-4d71-bd85-cabeee06dc74 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:18 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575 Nov 06 18:53:18 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:19 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2a92cdfc-c59f-4d71-bd85-cabeee06dc74 tempest-ProjectReaderTests-128439654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575" returned: 0 in 0.356s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2a92cdfc-c59f-4d71-bd85-cabeee06dc74 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.9a0c747e-96dc-4f72-8e0a-f39eaef430d2 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:19 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.9a0c747e-96dc-4f72-8e0a-f39eaef430d2 1G Nov 06 18:53:19 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:19 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2a92cdfc-c59f-4d71-bd85-cabeee06dc74 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.9a0c747e-96dc-4f72-8e0a-f39eaef430d2 1G" returned: 0 in 0.378s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2a92cdfc-c59f-4d71-bd85-cabeee06dc74 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6a45d4f-f4e2-403f-87dc-74686c2db575 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.9a0c747e-96dc-4f72-8e0a-f39eaef430d2 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:19 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6a45d4f-f4e2-403f-87dc-74686c2db575 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.9a0c747e-96dc-4f72-8e0a-f39eaef430d2 Nov 06 18:53:19 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:19 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2a92cdfc-c59f-4d71-bd85-cabeee06dc74 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6a45d4f-f4e2-403f-87dc-74686c2db575 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.9a0c747e-96dc-4f72-8e0a-f39eaef430d2" returned: 0 in 0.288s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:19 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-2a92cdfc-c59f-4d71-bd85-cabeee06dc74 tempest-ProjectReaderTests-128439654 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.9a0c747e-96dc-4f72-8e0a-f39eaef430d2 is being set with open permissions: ugo+rw Nov 06 18:53:19 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2a92cdfc-c59f-4d71-bd85-cabeee06dc74 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.9a0c747e-96dc-4f72-8e0a-f39eaef430d2 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:19 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.9a0c747e-96dc-4f72-8e0a-f39eaef430d2 Nov 06 18:53:19 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:20 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2a92cdfc-c59f-4d71-bd85-cabeee06dc74 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.9a0c747e-96dc-4f72-8e0a-f39eaef430d2" returned: 0 in 0.240s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2a92cdfc-c59f-4d71-bd85-cabeee06dc74 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:20 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.info Nov 06 18:53:20 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:20 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2a92cdfc-c59f-4d71-bd85-cabeee06dc74 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.info" returned: 0 in 0.239s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:20 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-2a92cdfc-c59f-4d71-bd85-cabeee06dc74 tempest-ProjectReaderTests-128439654 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.info is being set with open permissions: ugo+rw Nov 06 18:53:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2a92cdfc-c59f-4d71-bd85-cabeee06dc74 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:20 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.info Nov 06 18:53:20 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:20 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2a92cdfc-c59f-4d71-bd85-cabeee06dc74 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.info" returned: 0 in 0.244s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2a92cdfc-c59f-4d71-bd85-cabeee06dc74 tempest-ProjectReaderTests-128439654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:20 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-2a92cdfc-c59f-4d71-bd85-cabeee06dc74 tempest-ProjectReaderTests-128439654 None] Create snapshot completed successfully Nov 06 18:53:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-9a0c747e-96dc-4f72-8e0a-f39eaef430d2-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] Lock "cinder-9a0c747e-96dc-4f72-8e0a-f39eaef430d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-quobyte-c6a45d4f-f4e2-403f-87dc-74686c2db575" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-c6a45d4f-f4e2-403f-87dc-74686c2db575" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-quobyte-9a0c747e-96dc-4f72-8e0a-f39eaef430d2" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:20 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-9a0c747e-96dc-4f72-8e0a-f39eaef430d2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] Deleting offline snapshot 9a0c747e-96dc-4f72-8e0a-f39eaef430d2 of volume c6a45d4f-f4e2-403f-87dc-74686c2db575 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:53:20 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] snapshot_file for this snap is: volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.9a0c747e-96dc-4f72-8e0a-f39eaef430d2 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:53:20 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ca77af-acf5-451e-8120-10d7b9cd6b50]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:20 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.9a0c747e-96dc-4f72-8e0a-f39eaef430d2 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:21 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.9a0c747e-96dc-4f72-8e0a-f39eaef430d2 Nov 06 18:53:21 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:21 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.9a0c747e-96dc-4f72-8e0a-f39eaef430d2" returned: 0 in 0.357s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:21 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6a45d4f-f4e2-403f-87dc-74686c2db575(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:53:21 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3f6adf-e496-4794-b3b3-87ec01c7ef32]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:21 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575 Nov 06 18:53:21 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:21 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575" returned: 0 in 0.351s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:21 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.9a0c747e-96dc-4f72-8e0a-f39eaef430d2 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:21 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.9a0c747e-96dc-4f72-8e0a-f39eaef430d2 Nov 06 18:53:21 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:22 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.9a0c747e-96dc-4f72-8e0a-f39eaef430d2" returned: 0 in 0.327s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.9a0c747e-96dc-4f72-8e0a-f39eaef430d2 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:22 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.9a0c747e-96dc-4f72-8e0a-f39eaef430d2 Nov 06 18:53:22 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:22 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:22 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575.9a0c747e-96dc-4f72-8e0a-f39eaef430d2" returned: 0 in 0.242s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-9a0c747e-96dc-4f72-8e0a-f39eaef430d2" released by "_delete_snapshot" :: held 1.376s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-c6a45d4f-f4e2-403f-87dc-74686c2db575" released by "delete_snapshot" :: held 1.399s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:22 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] Created reservations ['e00d3c42-71f6-484f-81a1-25a2a6699d3a', '02be8510-e383-4795-aaf5-53acb4f6bfab', 'f969a7d6-fac2-494c-a298-250e5f1d2d3f', '8bfe921c-916e-4950-a63e-b2fe3e428ffb'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:53:22 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] Delete snapshot completed successfully. Nov 06 18:53:22 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-44d61fa5-573e-414f-88e0-6028501a0582 tempest-ProjectReaderTests-128439654 None] Lock "cinder-9a0c747e-96dc-4f72-8e0a-f39eaef430d2-delete_snapshot" released by "delete_snapshot" :: held 1.531s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7e766d12-f924-4420-bf5f-2900ff8d77a5 tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-c6a45d4f-f4e2-403f-87dc-74686c2db575-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7e766d12-f924-4420-bf5f-2900ff8d77a5 tempest-ProjectReaderTests-128439654 None] Lock "cinder-c6a45d4f-f4e2-403f-87dc-74686c2db575-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7e766d12-f924-4420-bf5f-2900ff8d77a5 tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-quobyte-c6a45d4f-f4e2-403f-87dc-74686c2db575" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7e766d12-f924-4420-bf5f-2900ff8d77a5 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-c6a45d4f-f4e2-403f-87dc-74686c2db575" acquired by "delete_volume" :: waited 0.013s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:23 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[df408a8c-c8de-4730-bff8-86917862fae6]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7e766d12-f924-4420-bf5f-2900ff8d77a5 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:23 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575 Nov 06 18:53:23 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:23 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7e766d12-f924-4420-bf5f-2900ff8d77a5 tempest-ProjectReaderTests-128439654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575" returned: 0 in 0.355s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7e766d12-f924-4420-bf5f-2900ff8d77a5 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:23 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575 Nov 06 18:53:23 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:23 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7e766d12-f924-4420-bf5f-2900ff8d77a5 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c6a45d4f-f4e2-403f-87dc-74686c2db575" returned: 0 in 0.238s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:23 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7e766d12-f924-4420-bf5f-2900ff8d77a5 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-c6a45d4f-f4e2-403f-87dc-74686c2db575" released by "delete_volume" :: held 0.651s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:23 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-7e766d12-f924-4420-bf5f-2900ff8d77a5 tempest-ProjectReaderTests-128439654 None] Created reservations ['76ef57b2-758d-400b-80f2-dea64e15819f', '87d8f5f0-52c0-4770-97d0-b064fefba3fe', '94371fc2-9e19-4805-a971-2eec488804df', '51964941-dd35-4685-ac79-360b1d09def9'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:53:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7e766d12-f924-4420-bf5f-2900ff8d77a5 tempest-ProjectReaderTests-128439654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7e766d12-f924-4420-bf5f-2900ff8d77a5 tempest-ProjectReaderTests-128439654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7e766d12-f924-4420-bf5f-2900ff8d77a5 tempest-ProjectReaderTests-128439654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:23 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-7e766d12-f924-4420-bf5f-2900ff8d77a5 tempest-ProjectReaderTests-128439654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-7e766d12-f924-4420-bf5f-2900ff8d77a5 tempest-ProjectReaderTests-128439654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:23 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7e766d12-f924-4420-bf5f-2900ff8d77a5 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:23 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:53:23 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:24 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-7e766d12-f924-4420-bf5f-2900ff8d77a5 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.243s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-7e766d12-f924-4420-bf5f-2900ff8d77a5 tempest-ProjectReaderTests-128439654 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:53:24 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-7e766d12-f924-4420-bf5f-2900ff8d77a5 tempest-ProjectReaderTests-128439654 None] Deleted volume successfully. Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-7e766d12-f924-4420-bf5f-2900ff8d77a5 tempest-ProjectReaderTests-128439654 None] Lock "cinder-c6a45d4f-f4e2-403f-87dc-74686c2db575-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Flow 'volume_create_manager' (a93ea03d-bfe3-40ac-8e53-7ed7aeaa269e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f7dfe9-db61-4a9f-ae66-f48b3fdc3321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f7dfe9-db61-4a9f-ae66-f48b3fdc3321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2101514642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf301711-5bc4-49ca-b853-bac42ec4b5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2671262bfcfe4f56b2546faeeadbf2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:53:25Z,use_quota=True,user_id='d6304724b1574356866724b36417c779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9e407f-ee81-42b7-9469-6be47847f359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9e407f-ee81-42b7-9469-6be47847f359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df37a0f6-ec5f-4dac-8751-f85ad0edf511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df37a0f6-ec5f-4dac-8751-f85ad0edf511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf301711-5bc4-49ca-b853-bac42ec4b5e9', 'volume_name': 'volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec446e18-b8b1-485b-b1fc-081aa1a0c709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec446e18-b8b1-485b-b1fc-081aa1a0c709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c71c316-a978-4b78-a73c-4a5e6b5fe4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:24 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Volume bf301711-5bc4-49ca-b853-bac42ec4b5e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9', 'volume_size': 1} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2101514642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf301711-5bc4-49ca-b853-bac42ec4b5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2671262bfcfe4f56b2546faeeadbf2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:53:25Z,use_quota=True,user_id='d6304724b1574356866724b36417c779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Creating volume bf301711-5bc4-49ca-b853-bac42ec4b5e9 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:53:24 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:53:24 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:24 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9 1073741824 Nov 06 18:53:24 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:25 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9 1073741824" returned: 0 in 0.397s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:25 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9 Nov 06 18:53:25 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:25 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9" returned: 0 in 0.240s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:53:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c71c316-a978-4b78-a73c-4a5e6b5fe4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9466d41d-a8a6-4835-859e-42944746c0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:25 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Volume volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9 (bf301711-5bc4-49ca-b853-bac42ec4b5e9): created successfully Nov 06 18:53:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9466d41d-a8a6-4835-859e-42944746c0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:25 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Flow 'volume_create_manager' (a93ea03d-bfe3-40ac-8e53-7ed7aeaa269e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:53:25 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c6cb780e-76ac-465e-98c0-3e13c424d6ae tempest-ProjectReaderTests-128439654 None] Created volume successfully. Nov 06 18:53:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-68a9cb9e-7332-4f95-a208-6ea8ae3d3f3e tempest-ProjectReaderTests-128439654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-68a9cb9e-7332-4f95-a208-6ea8ae3d3f3e tempest-ProjectReaderTests-128439654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:25 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-68a9cb9e-7332-4f95-a208-6ea8ae3d3f3e tempest-ProjectReaderTests-128439654 None] Creating offline snapshot 08514a3a-a1ca-4bc6-b7de-295c0d7d8a97 of volume bf301711-5bc4-49ca-b853-bac42ec4b5e9 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:53:25 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[680ab307-3ff6-4418-bd74-445a9199df13]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:25 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-68a9cb9e-7332-4f95-a208-6ea8ae3d3f3e tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:25 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9 Nov 06 18:53:25 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:26 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-68a9cb9e-7332-4f95-a208-6ea8ae3d3f3e tempest-ProjectReaderTests-128439654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9" returned: 0 in 0.358s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-68a9cb9e-7332-4f95-a208-6ea8ae3d3f3e tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.08514a3a-a1ca-4bc6-b7de-295c0d7d8a97 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:26 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.08514a3a-a1ca-4bc6-b7de-295c0d7d8a97 1G Nov 06 18:53:26 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:26 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-68a9cb9e-7332-4f95-a208-6ea8ae3d3f3e tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.08514a3a-a1ca-4bc6-b7de-295c0d7d8a97 1G" returned: 0 in 0.386s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-68a9cb9e-7332-4f95-a208-6ea8ae3d3f3e tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.08514a3a-a1ca-4bc6-b7de-295c0d7d8a97 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:26 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.08514a3a-a1ca-4bc6-b7de-295c0d7d8a97 Nov 06 18:53:26 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:26 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-68a9cb9e-7332-4f95-a208-6ea8ae3d3f3e tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.08514a3a-a1ca-4bc6-b7de-295c0d7d8a97" returned: 0 in 0.292s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:26 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-68a9cb9e-7332-4f95-a208-6ea8ae3d3f3e tempest-ProjectReaderTests-128439654 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.08514a3a-a1ca-4bc6-b7de-295c0d7d8a97 is being set with open permissions: ugo+rw Nov 06 18:53:26 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-68a9cb9e-7332-4f95-a208-6ea8ae3d3f3e tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.08514a3a-a1ca-4bc6-b7de-295c0d7d8a97 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:26 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.08514a3a-a1ca-4bc6-b7de-295c0d7d8a97 Nov 06 18:53:26 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:27 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-68a9cb9e-7332-4f95-a208-6ea8ae3d3f3e tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.08514a3a-a1ca-4bc6-b7de-295c0d7d8a97" returned: 0 in 0.245s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-68a9cb9e-7332-4f95-a208-6ea8ae3d3f3e tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:27 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.info Nov 06 18:53:27 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:27 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-68a9cb9e-7332-4f95-a208-6ea8ae3d3f3e tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.info" returned: 0 in 0.259s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:27 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-68a9cb9e-7332-4f95-a208-6ea8ae3d3f3e tempest-ProjectReaderTests-128439654 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.info is being set with open permissions: ugo+rw Nov 06 18:53:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-68a9cb9e-7332-4f95-a208-6ea8ae3d3f3e tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:27 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.info Nov 06 18:53:27 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:27 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-68a9cb9e-7332-4f95-a208-6ea8ae3d3f3e tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.info" returned: 0 in 0.245s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-68a9cb9e-7332-4f95-a208-6ea8ae3d3f3e tempest-ProjectReaderTests-128439654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.864s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:27 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-68a9cb9e-7332-4f95-a208-6ea8ae3d3f3e tempest-ProjectReaderTests-128439654 None] Create snapshot completed successfully Nov 06 18:53:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-08514a3a-a1ca-4bc6-b7de-295c0d7d8a97-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] Lock "cinder-08514a3a-a1ca-4bc6-b7de-295c0d7d8a97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-quobyte-bf301711-5bc4-49ca-b853-bac42ec4b5e9" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-bf301711-5bc4-49ca-b853-bac42ec4b5e9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-quobyte-08514a3a-a1ca-4bc6-b7de-295c0d7d8a97" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:27 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-08514a3a-a1ca-4bc6-b7de-295c0d7d8a97" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] Deleting offline snapshot 08514a3a-a1ca-4bc6-b7de-295c0d7d8a97 of volume bf301711-5bc4-49ca-b853-bac42ec4b5e9 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:53:27 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] snapshot_file for this snap is: volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.08514a3a-a1ca-4bc6-b7de-295c0d7d8a97 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:53:27 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecba43f0-c694-4a07-84e5-e2a02f5544e7]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:27 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.08514a3a-a1ca-4bc6-b7de-295c0d7d8a97 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:28 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.08514a3a-a1ca-4bc6-b7de-295c0d7d8a97 Nov 06 18:53:28 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:28 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.08514a3a-a1ca-4bc6-b7de-295c0d7d8a97" returned: 0 in 0.354s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:28 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:53:28 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a240371-17ed-4ae3-9f59-cdd6a748a1f4]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:28 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9 Nov 06 18:53:28 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:28 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9" returned: 0 in 0.350s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:28 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.08514a3a-a1ca-4bc6-b7de-295c0d7d8a97 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:28 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.08514a3a-a1ca-4bc6-b7de-295c0d7d8a97 Nov 06 18:53:28 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:29 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.08514a3a-a1ca-4bc6-b7de-295c0d7d8a97" returned: 0 in 0.374s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.08514a3a-a1ca-4bc6-b7de-295c0d7d8a97 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:29 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.08514a3a-a1ca-4bc6-b7de-295c0d7d8a97 Nov 06 18:53:29 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:53:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:29 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:29 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:53:29 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:29 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9.08514a3a-a1ca-4bc6-b7de-295c0d7d8a97" returned: 0 in 0.250s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-08514a3a-a1ca-4bc6-b7de-295c0d7d8a97" released by "_delete_snapshot" :: held 1.432s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-bf301711-5bc4-49ca-b853-bac42ec4b5e9" released by "delete_snapshot" :: held 1.461s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:29 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] Created reservations ['64f41513-58e3-486a-9435-25e4a38d8c35', '0db6cfea-a523-41ab-89d8-c1fb8aac0613', '39ed4347-e356-4f24-810e-0080232dc927', '6a898add-54b5-4784-8a32-0b0d264e5b92'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:53:29 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] Delete snapshot completed successfully. Nov 06 18:53:29 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-56f13f54-d2c0-4d3f-b124-f02ff32a2ba0 tempest-ProjectReaderTests-128439654 None] Lock "cinder-08514a3a-a1ca-4bc6-b7de-295c0d7d8a97-delete_snapshot" released by "delete_snapshot" :: held 1.614s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:29 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:29 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.267s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:29 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:53:29 devstack cinder-volume[86794]: DEBUG oslo_service.periodic_task [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] Running periodic task VolumeManager._thread_info {{(pid=86794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:53:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread count: 29 {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:53:29 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-cf376fc5-4bc9-4b66-b182-338786a5b5ac None None] thread info: [<_MainThread(MainThread, started 137619969446016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:53:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e841d7e4-ed38-469a-9b8b-7159d25ec7e4 tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-bf301711-5bc4-49ca-b853-bac42ec4b5e9-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e841d7e4-ed38-469a-9b8b-7159d25ec7e4 tempest-ProjectReaderTests-128439654 None] Lock "cinder-bf301711-5bc4-49ca-b853-bac42ec4b5e9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e841d7e4-ed38-469a-9b8b-7159d25ec7e4 tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-quobyte-bf301711-5bc4-49ca-b853-bac42ec4b5e9" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e841d7e4-ed38-469a-9b8b-7159d25ec7e4 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-bf301711-5bc4-49ca-b853-bac42ec4b5e9" acquired by "delete_volume" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:30 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f34f409-9989-4d86-beea-e426ae97676b]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e841d7e4-ed38-469a-9b8b-7159d25ec7e4 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:30 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9 Nov 06 18:53:30 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:30 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e841d7e4-ed38-469a-9b8b-7159d25ec7e4 tempest-ProjectReaderTests-128439654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9" returned: 0 in 0.358s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e841d7e4-ed38-469a-9b8b-7159d25ec7e4 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:30 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9 Nov 06 18:53:30 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:30 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e841d7e4-ed38-469a-9b8b-7159d25ec7e4 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-bf301711-5bc4-49ca-b853-bac42ec4b5e9" returned: 0 in 0.260s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:30 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e841d7e4-ed38-469a-9b8b-7159d25ec7e4 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-bf301711-5bc4-49ca-b853-bac42ec4b5e9" released by "delete_volume" :: held 0.678s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:30 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-e841d7e4-ed38-469a-9b8b-7159d25ec7e4 tempest-ProjectReaderTests-128439654 None] Created reservations ['8b22e68d-9b11-4992-a0ee-5d62b5491386', 'e98099c6-f71f-49b9-bacc-d091459bface', 'd73ddf54-54bf-4b4f-89d3-59f182655844', '7e6f3c90-1211-477e-96e6-4dc7b82c83de'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:53:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e841d7e4-ed38-469a-9b8b-7159d25ec7e4 tempest-ProjectReaderTests-128439654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e841d7e4-ed38-469a-9b8b-7159d25ec7e4 tempest-ProjectReaderTests-128439654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e841d7e4-ed38-469a-9b8b-7159d25ec7e4 tempest-ProjectReaderTests-128439654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:30 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e841d7e4-ed38-469a-9b8b-7159d25ec7e4 tempest-ProjectReaderTests-128439654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e841d7e4-ed38-469a-9b8b-7159d25ec7e4 tempest-ProjectReaderTests-128439654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:30 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e841d7e4-ed38-469a-9b8b-7159d25ec7e4 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:30 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:53:30 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:31 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e841d7e4-ed38-469a-9b8b-7159d25ec7e4 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.247s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-e841d7e4-ed38-469a-9b8b-7159d25ec7e4 tempest-ProjectReaderTests-128439654 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:53:31 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-e841d7e4-ed38-469a-9b8b-7159d25ec7e4 tempest-ProjectReaderTests-128439654 None] Deleted volume successfully. Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-e841d7e4-ed38-469a-9b8b-7159d25ec7e4 tempest-ProjectReaderTests-128439654 None] Lock "cinder-bf301711-5bc4-49ca-b853-bac42ec4b5e9-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Flow 'volume_create_manager' (28dad091-7426-4e1c-aa56-6d1924b204d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf08f669-7ca1-48fb-927b-bf42f2fdbba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf08f669-7ca1-48fb-927b-bf42f2fdbba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-323231816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793bc32e-b304-4cc8-b3c3-309e47f8b4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2671262bfcfe4f56b2546faeeadbf2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:53:32Z,use_quota=True,user_id='d6304724b1574356866724b36417c779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dac6801-cd2a-4565-bc43-3e01179d1353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dac6801-cd2a-4565-bc43-3e01179d1353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a3a71d-d502-4388-9b8c-44077c29d9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a3a71d-d502-4388-9b8c-44077c29d9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '793bc32e-b304-4cc8-b3c3-309e47f8b4be', 'volume_name': 'volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09aff944-4023-4093-90d5-05342c4df865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09aff944-4023-4093-90d5-05342c4df865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6f91a6-8d46-48b4-9475-f54fe0cc4370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:31 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Volume 793bc32e-b304-4cc8-b3c3-309e47f8b4be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be', 'volume_size': 1} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-323231816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793bc32e-b304-4cc8-b3c3-309e47f8b4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2671262bfcfe4f56b2546faeeadbf2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:53:32Z,use_quota=True,user_id='d6304724b1574356866724b36417c779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Creating volume 793bc32e-b304-4cc8-b3c3-309e47f8b4be {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:53:31 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:53:31 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:31 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be 1073741824 Nov 06 18:53:31 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:32 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be 1073741824" returned: 0 in 0.421s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:32 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be Nov 06 18:53:32 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:32 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be" returned: 0 in 0.246s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:32 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:53:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6f91a6-8d46-48b4-9475-f54fe0cc4370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d797edd-caa9-4dce-a465-f0f346f1c55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:32 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Volume volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be (793bc32e-b304-4cc8-b3c3-309e47f8b4be): created successfully Nov 06 18:53:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d797edd-caa9-4dce-a465-f0f346f1c55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:32 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Flow 'volume_create_manager' (28dad091-7426-4e1c-aa56-6d1924b204d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:53:32 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-2735a091-74e9-4c25-841d-b3135c664e1f tempest-ProjectReaderTests-128439654 None] Created volume successfully. Nov 06 18:53:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dbe43a5f-67b8-412a-ac31-b558edfc272f tempest-ProjectReaderTests-128439654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dbe43a5f-67b8-412a-ac31-b558edfc272f tempest-ProjectReaderTests-128439654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:32 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-dbe43a5f-67b8-412a-ac31-b558edfc272f tempest-ProjectReaderTests-128439654 None] Creating offline snapshot 7253a2ec-af58-4468-b1eb-b1520d9bab18 of volume 793bc32e-b304-4cc8-b3c3-309e47f8b4be {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:53:32 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[856859a3-884c-44db-93d1-6362a5ab8995]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:32 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbe43a5f-67b8-412a-ac31-b558edfc272f tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:32 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be Nov 06 18:53:32 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:33 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbe43a5f-67b8-412a-ac31-b558edfc272f tempest-ProjectReaderTests-128439654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be" returned: 0 in 0.353s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbe43a5f-67b8-412a-ac31-b558edfc272f tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.7253a2ec-af58-4468-b1eb-b1520d9bab18 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:33 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.7253a2ec-af58-4468-b1eb-b1520d9bab18 1G Nov 06 18:53:33 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:33 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbe43a5f-67b8-412a-ac31-b558edfc272f tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.7253a2ec-af58-4468-b1eb-b1520d9bab18 1G" returned: 0 in 0.395s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbe43a5f-67b8-412a-ac31-b558edfc272f tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.7253a2ec-af58-4468-b1eb-b1520d9bab18 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:33 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.7253a2ec-af58-4468-b1eb-b1520d9bab18 Nov 06 18:53:33 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:33 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbe43a5f-67b8-412a-ac31-b558edfc272f tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.7253a2ec-af58-4468-b1eb-b1520d9bab18" returned: 0 in 0.289s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:33 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-dbe43a5f-67b8-412a-ac31-b558edfc272f tempest-ProjectReaderTests-128439654 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.7253a2ec-af58-4468-b1eb-b1520d9bab18 is being set with open permissions: ugo+rw Nov 06 18:53:33 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbe43a5f-67b8-412a-ac31-b558edfc272f tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.7253a2ec-af58-4468-b1eb-b1520d9bab18 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:33 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.7253a2ec-af58-4468-b1eb-b1520d9bab18 Nov 06 18:53:33 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:34 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbe43a5f-67b8-412a-ac31-b558edfc272f tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.7253a2ec-af58-4468-b1eb-b1520d9bab18" returned: 0 in 0.236s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbe43a5f-67b8-412a-ac31-b558edfc272f tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:34 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.info Nov 06 18:53:34 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:34 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbe43a5f-67b8-412a-ac31-b558edfc272f tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.info" returned: 0 in 0.245s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:34 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-dbe43a5f-67b8-412a-ac31-b558edfc272f tempest-ProjectReaderTests-128439654 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.info is being set with open permissions: ugo+rw Nov 06 18:53:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbe43a5f-67b8-412a-ac31-b558edfc272f tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:34 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.info Nov 06 18:53:34 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:34 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-dbe43a5f-67b8-412a-ac31-b558edfc272f tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.info" returned: 0 in 0.236s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:34 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-dbe43a5f-67b8-412a-ac31-b558edfc272f tempest-ProjectReaderTests-128439654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:34 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-dbe43a5f-67b8-412a-ac31-b558edfc272f tempest-ProjectReaderTests-128439654 None] Create snapshot completed successfully Nov 06 18:53:34 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-7253a2ec-af58-4468-b1eb-b1520d9bab18-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:34 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] Lock "cinder-7253a2ec-af58-4468-b1eb-b1520d9bab18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:34 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-quobyte-793bc32e-b304-4cc8-b3c3-309e47f8b4be" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:34 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-793bc32e-b304-4cc8-b3c3-309e47f8b4be" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:34 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-quobyte-7253a2ec-af58-4468-b1eb-b1520d9bab18" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:34 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-7253a2ec-af58-4468-b1eb-b1520d9bab18" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:34 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] Deleting offline snapshot 7253a2ec-af58-4468-b1eb-b1520d9bab18 of volume 793bc32e-b304-4cc8-b3c3-309e47f8b4be {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:53:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] snapshot_file for this snap is: volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.7253a2ec-af58-4468-b1eb-b1520d9bab18 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:53:35 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58207db-291d-4341-9dcc-3e5d2e76d761]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.7253a2ec-af58-4468-b1eb-b1520d9bab18 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:35 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.7253a2ec-af58-4468-b1eb-b1520d9bab18 Nov 06 18:53:35 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:35 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.7253a2ec-af58-4468-b1eb-b1520d9bab18" returned: 0 in 0.340s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:35 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:53:35 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee7c943-ce99-447d-9e2e-512e4853f75b]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:35 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be Nov 06 18:53:35 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:35 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be" returned: 0 in 0.348s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:35 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.7253a2ec-af58-4468-b1eb-b1520d9bab18 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:35 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.7253a2ec-af58-4468-b1eb-b1520d9bab18 Nov 06 18:53:35 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:36 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.7253a2ec-af58-4468-b1eb-b1520d9bab18" returned: 0 in 0.328s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.7253a2ec-af58-4468-b1eb-b1520d9bab18 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:36 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.7253a2ec-af58-4468-b1eb-b1520d9bab18 Nov 06 18:53:36 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:36 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:36 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be.7253a2ec-af58-4468-b1eb-b1520d9bab18" returned: 0 in 0.244s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-7253a2ec-af58-4468-b1eb-b1520d9bab18" released by "_delete_snapshot" :: held 1.356s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-793bc32e-b304-4cc8-b3c3-309e47f8b4be" released by "delete_snapshot" :: held 1.376s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:36 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] Created reservations ['d6c6f457-2cb9-4ba7-a7ff-41d76253a25d', '07af99cb-5056-4a08-83c0-52ef0aba9c8c', '44e09482-d389-4bb7-bb73-b89f256025f1', '4b5754b2-8b8d-4c52-91e4-c2ef5ba0e63b'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:53:36 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] Delete snapshot completed successfully. Nov 06 18:53:36 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-c4069aa9-0c70-41f0-9edf-240a3b0fe85a tempest-ProjectReaderTests-128439654 None] Lock "cinder-7253a2ec-af58-4468-b1eb-b1520d9bab18-delete_snapshot" released by "delete_snapshot" :: held 1.499s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fbfb6fc3-9a3e-4c29-8b2c-f23da6e55f4f tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-793bc32e-b304-4cc8-b3c3-309e47f8b4be-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fbfb6fc3-9a3e-4c29-8b2c-f23da6e55f4f tempest-ProjectReaderTests-128439654 None] Lock "cinder-793bc32e-b304-4cc8-b3c3-309e47f8b4be-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fbfb6fc3-9a3e-4c29-8b2c-f23da6e55f4f tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-quobyte-793bc32e-b304-4cc8-b3c3-309e47f8b4be" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fbfb6fc3-9a3e-4c29-8b2c-f23da6e55f4f tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-793bc32e-b304-4cc8-b3c3-309e47f8b4be" acquired by "delete_volume" :: waited 0.013s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:37 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f60e897-47d5-428d-ac05-7e5b254612f0]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fbfb6fc3-9a3e-4c29-8b2c-f23da6e55f4f tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:37 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be Nov 06 18:53:37 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:37 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fbfb6fc3-9a3e-4c29-8b2c-f23da6e55f4f tempest-ProjectReaderTests-128439654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be" returned: 0 in 0.345s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fbfb6fc3-9a3e-4c29-8b2c-f23da6e55f4f tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:37 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be Nov 06 18:53:37 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:37 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fbfb6fc3-9a3e-4c29-8b2c-f23da6e55f4f tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-793bc32e-b304-4cc8-b3c3-309e47f8b4be" returned: 0 in 0.247s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:37 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fbfb6fc3-9a3e-4c29-8b2c-f23da6e55f4f tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-793bc32e-b304-4cc8-b3c3-309e47f8b4be" released by "delete_volume" :: held 0.648s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:37 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-fbfb6fc3-9a3e-4c29-8b2c-f23da6e55f4f tempest-ProjectReaderTests-128439654 None] Created reservations ['b8b293bf-d211-44d2-b318-e3fd78620d43', 'f552bddb-99c8-41be-ae72-dfbec23c6c36', '977ee8b2-655d-4c7a-8264-f2295d890b33', '85869a53-9395-4409-a357-c46f564ec593'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:53:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fbfb6fc3-9a3e-4c29-8b2c-f23da6e55f4f tempest-ProjectReaderTests-128439654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fbfb6fc3-9a3e-4c29-8b2c-f23da6e55f4f tempest-ProjectReaderTests-128439654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fbfb6fc3-9a3e-4c29-8b2c-f23da6e55f4f tempest-ProjectReaderTests-128439654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:37 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-fbfb6fc3-9a3e-4c29-8b2c-f23da6e55f4f tempest-ProjectReaderTests-128439654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-fbfb6fc3-9a3e-4c29-8b2c-f23da6e55f4f tempest-ProjectReaderTests-128439654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:37 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fbfb6fc3-9a3e-4c29-8b2c-f23da6e55f4f tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:37 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:53:37 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:38 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-fbfb6fc3-9a3e-4c29-8b2c-f23da6e55f4f tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.247s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-fbfb6fc3-9a3e-4c29-8b2c-f23da6e55f4f tempest-ProjectReaderTests-128439654 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:53:38 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-fbfb6fc3-9a3e-4c29-8b2c-f23da6e55f4f tempest-ProjectReaderTests-128439654 None] Deleted volume successfully. Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-fbfb6fc3-9a3e-4c29-8b2c-f23da6e55f4f tempest-ProjectReaderTests-128439654 None] Lock "cinder-793bc32e-b304-4cc8-b3c3-309e47f8b4be-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Flow 'volume_create_manager' (f1c462c7-907f-41c6-93dc-aeb055b8c011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a32c6404-1daf-42e5-bb0a-c890750bdd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a32c6404-1daf-42e5-bb0a-c890750bdd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-76991843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c0b08a-27c0-47f5-87e7-83ba5b533e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2671262bfcfe4f56b2546faeeadbf2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:53:39Z,use_quota=True,user_id='d6304724b1574356866724b36417c779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea6c12d1-c309-4026-a860-9d77cb091a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea6c12d1-c309-4026-a860-9d77cb091a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68a637f-b946-4d71-ba83-c19abf457490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68a637f-b946-4d71-ba83-c19abf457490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89c0b08a-27c0-47f5-87e7-83ba5b533e95', 'volume_name': 'volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3344fd2a-d97f-44dc-bd53-bf72920e4b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3344fd2a-d97f-44dc-bd53-bf72920e4b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4faa1c73-d1a6-4fb9-b503-dcf2e051a831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:38 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Volume 89c0b08a-27c0-47f5-87e7-83ba5b533e95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95', 'volume_size': 1} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-76991843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c0b08a-27c0-47f5-87e7-83ba5b533e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2671262bfcfe4f56b2546faeeadbf2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:53:39Z,use_quota=True,user_id='d6304724b1574356866724b36417c779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Creating volume 89c0b08a-27c0-47f5-87e7-83ba5b533e95 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:53:38 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:53:38 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:38 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95 1073741824 Nov 06 18:53:38 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:39 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95 1073741824" returned: 0 in 0.398s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:39 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95 Nov 06 18:53:39 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:39 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95" returned: 0 in 0.244s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:53:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4faa1c73-d1a6-4fb9-b503-dcf2e051a831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a96ada24-34e5-4c6b-8e9a-5007bb88aeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:39 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Volume volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95 (89c0b08a-27c0-47f5-87e7-83ba5b533e95): created successfully Nov 06 18:53:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a96ada24-34e5-4c6b-8e9a-5007bb88aeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:39 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Flow 'volume_create_manager' (f1c462c7-907f-41c6-93dc-aeb055b8c011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:53:39 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-2da7bfc4-ed69-4cea-97b4-6b9785bfd861 tempest-ProjectReaderTests-128439654 None] Created volume successfully. Nov 06 18:53:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0e19f1f9-e834-4049-b9f3-a0875cbafb6b tempest-ProjectReaderTests-128439654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0e19f1f9-e834-4049-b9f3-a0875cbafb6b tempest-ProjectReaderTests-128439654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:39 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-0e19f1f9-e834-4049-b9f3-a0875cbafb6b tempest-ProjectReaderTests-128439654 None] Creating offline snapshot 1066047a-904a-49bc-909c-a02ed77fc722 of volume 89c0b08a-27c0-47f5-87e7-83ba5b533e95 {{(pid=86794) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:53:39 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ee40cb-3ac6-49d3-80b0-9437eda5e558]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:39 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0e19f1f9-e834-4049-b9f3-a0875cbafb6b tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:39 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95 Nov 06 18:53:39 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:40 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0e19f1f9-e834-4049-b9f3-a0875cbafb6b tempest-ProjectReaderTests-128439654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95" returned: 0 in 0.351s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0e19f1f9-e834-4049-b9f3-a0875cbafb6b tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.1066047a-904a-49bc-909c-a02ed77fc722 1G {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:40 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.1066047a-904a-49bc-909c-a02ed77fc722 1G Nov 06 18:53:40 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:40 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0e19f1f9-e834-4049-b9f3-a0875cbafb6b tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.1066047a-904a-49bc-909c-a02ed77fc722 1G" returned: 0 in 0.380s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0e19f1f9-e834-4049-b9f3-a0875cbafb6b tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.1066047a-904a-49bc-909c-a02ed77fc722 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:40 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.1066047a-904a-49bc-909c-a02ed77fc722 Nov 06 18:53:40 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:40 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0e19f1f9-e834-4049-b9f3-a0875cbafb6b tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95 -F qcow2 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.1066047a-904a-49bc-909c-a02ed77fc722" returned: 0 in 0.302s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:40 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-0e19f1f9-e834-4049-b9f3-a0875cbafb6b tempest-ProjectReaderTests-128439654 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.1066047a-904a-49bc-909c-a02ed77fc722 is being set with open permissions: ugo+rw Nov 06 18:53:40 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0e19f1f9-e834-4049-b9f3-a0875cbafb6b tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.1066047a-904a-49bc-909c-a02ed77fc722 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:40 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.1066047a-904a-49bc-909c-a02ed77fc722 Nov 06 18:53:40 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:41 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0e19f1f9-e834-4049-b9f3-a0875cbafb6b tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.1066047a-904a-49bc-909c-a02ed77fc722" returned: 0 in 0.245s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0e19f1f9-e834-4049-b9f3-a0875cbafb6b tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:41 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.info Nov 06 18:53:41 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:41 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0e19f1f9-e834-4049-b9f3-a0875cbafb6b tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.info" returned: 0 in 0.251s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:41 devstack cinder-volume[86794]: WARNING cinder.volume.drivers.remotefs [None req-0e19f1f9-e834-4049-b9f3-a0875cbafb6b tempest-ProjectReaderTests-128439654 None] /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.info is being set with open permissions: ugo+rw Nov 06 18:53:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0e19f1f9-e834-4049-b9f3-a0875cbafb6b tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.info {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:41 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.info Nov 06 18:53:41 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:41 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-0e19f1f9-e834-4049-b9f3-a0875cbafb6b tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.info" returned: 0 in 0.245s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:41 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-0e19f1f9-e834-4049-b9f3-a0875cbafb6b tempest-ProjectReaderTests-128439654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.855s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:41 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-0e19f1f9-e834-4049-b9f3-a0875cbafb6b tempest-ProjectReaderTests-128439654 None] Create snapshot completed successfully Nov 06 18:53:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-1066047a-904a-49bc-909c-a02ed77fc722-delete_snapshot" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] Lock "cinder-1066047a-904a-49bc-909c-a02ed77fc722-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-quobyte-89c0b08a-27c0-47f5-87e7-83ba5b533e95" by "delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-89c0b08a-27c0-47f5-87e7-83ba5b533e95" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-quobyte-1066047a-904a-49bc-909c-a02ed77fc722" by "_delete_snapshot" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:41 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-1066047a-904a-49bc-909c-a02ed77fc722" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:41 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] Deleting offline snapshot 1066047a-904a-49bc-909c-a02ed77fc722 of volume 89c0b08a-27c0-47f5-87e7-83ba5b533e95 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:53:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] snapshot_file for this snap is: volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.1066047a-904a-49bc-909c-a02ed77fc722 {{(pid=86794) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:53:42 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[63527ced-7cde-4cc5-a71b-86fb036d8c07]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.1066047a-904a-49bc-909c-a02ed77fc722 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:42 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.1066047a-904a-49bc-909c-a02ed77fc722 Nov 06 18:53:42 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:42 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.1066047a-904a-49bc-909c-a02ed77fc722" returned: 0 in 0.351s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:42 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86794) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:53:42 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a602f5d-cb1d-46f5-98ea-3a0efa8a776e]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:42 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95 Nov 06 18:53:42 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:42 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95" returned: 0 in 0.349s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:42 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.1066047a-904a-49bc-909c-a02ed77fc722 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:42 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.1066047a-904a-49bc-909c-a02ed77fc722 Nov 06 18:53:42 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:43 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.1066047a-904a-49bc-909c-a02ed77fc722" returned: 0 in 0.329s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.1066047a-904a-49bc-909c-a02ed77fc722 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:43 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.1066047a-904a-49bc-909c-a02ed77fc722 Nov 06 18:53:43 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:43 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:43 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95.1066047a-904a-49bc-909c-a02ed77fc722" returned: 0 in 0.244s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-1066047a-904a-49bc-909c-a02ed77fc722" released by "_delete_snapshot" :: held 1.371s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-89c0b08a-27c0-47f5-87e7-83ba5b533e95" released by "delete_snapshot" :: held 1.393s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:43 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] Created reservations ['9cd861a6-0eee-4033-9079-4ab12d3ec7b2', '7274680d-4788-4e10-a736-42083f0fe897', 'f8f8e877-4b86-47b0-bd93-3d3031199e83', 'c712c75f-39df-4754-a269-3fee76261617'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:53:43 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] Delete snapshot completed successfully. Nov 06 18:53:43 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-3dc8174b-cdda-40bf-97da-01a17c225f37 tempest-ProjectReaderTests-128439654 None] Lock "cinder-1066047a-904a-49bc-909c-a02ed77fc722-delete_snapshot" released by "delete_snapshot" :: held 1.526s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-75d7cb82-a3f0-4788-98d1-a5671c5dc9b9 tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-89c0b08a-27c0-47f5-87e7-83ba5b533e95-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-75d7cb82-a3f0-4788-98d1-a5671c5dc9b9 tempest-ProjectReaderTests-128439654 None] Lock "cinder-89c0b08a-27c0-47f5-87e7-83ba5b533e95-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-75d7cb82-a3f0-4788-98d1-a5671c5dc9b9 tempest-ProjectReaderTests-128439654 None] Acquiring lock "cinder-quobyte-89c0b08a-27c0-47f5-87e7-83ba5b533e95" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-75d7cb82-a3f0-4788-98d1-a5671c5dc9b9 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-89c0b08a-27c0-47f5-87e7-83ba5b533e95" acquired by "delete_volume" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:44 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cbbc78-a587-4cfc-ad3b-94a72e599577]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75d7cb82-a3f0-4788-98d1-a5671c5dc9b9 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:44 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95 Nov 06 18:53:44 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:44 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75d7cb82-a3f0-4788-98d1-a5671c5dc9b9 tempest-ProjectReaderTests-128439654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95" returned: 0 in 0.348s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75d7cb82-a3f0-4788-98d1-a5671c5dc9b9 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:44 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95 Nov 06 18:53:44 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:44 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75d7cb82-a3f0-4788-98d1-a5671c5dc9b9 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-89c0b08a-27c0-47f5-87e7-83ba5b533e95" returned: 0 in 0.244s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:44 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-75d7cb82-a3f0-4788-98d1-a5671c5dc9b9 tempest-ProjectReaderTests-128439654 None] Lock "cinder-quobyte-89c0b08a-27c0-47f5-87e7-83ba5b533e95" released by "delete_volume" :: held 0.653s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:44 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-75d7cb82-a3f0-4788-98d1-a5671c5dc9b9 tempest-ProjectReaderTests-128439654 None] Created reservations ['ea40d5a2-076d-4f2a-9028-2ae946160b77', '461d92af-a772-4229-bfe4-76d1944cbd62', 'fc548fa2-cd9e-4430-ae2d-96a6c6e9da1c', '66d8d686-0770-41a7-a08f-20b9e5256064'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:53:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-75d7cb82-a3f0-4788-98d1-a5671c5dc9b9 tempest-ProjectReaderTests-128439654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-75d7cb82-a3f0-4788-98d1-a5671c5dc9b9 tempest-ProjectReaderTests-128439654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-75d7cb82-a3f0-4788-98d1-a5671c5dc9b9 tempest-ProjectReaderTests-128439654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:44 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-75d7cb82-a3f0-4788-98d1-a5671c5dc9b9 tempest-ProjectReaderTests-128439654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-75d7cb82-a3f0-4788-98d1-a5671c5dc9b9 tempest-ProjectReaderTests-128439654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:44 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75d7cb82-a3f0-4788-98d1-a5671c5dc9b9 tempest-ProjectReaderTests-128439654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:44 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:53:44 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:45 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:45 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-75d7cb82-a3f0-4788-98d1-a5671c5dc9b9 tempest-ProjectReaderTests-128439654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.241s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:45 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-75d7cb82-a3f0-4788-98d1-a5671c5dc9b9 tempest-ProjectReaderTests-128439654 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:53:45 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-75d7cb82-a3f0-4788-98d1-a5671c5dc9b9 tempest-ProjectReaderTests-128439654 None] Deleted volume successfully. Nov 06 18:53:45 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-75d7cb82-a3f0-4788-98d1-a5671c5dc9b9 tempest-ProjectReaderTests-128439654 None] Lock "cinder-89c0b08a-27c0-47f5-87e7-83ba5b533e95-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Flow 'volume_create_manager' (65c947c4-f07b-4fa7-a2ee-f82ef3b4100d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f7aa24-a253-487b-b256-4c5f9c8694a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f7aa24-a253-487b-b256-4c5f9c8694a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698771853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5281f988-7d3c-457f-b719-2dac8c0c74b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fa0c1bdd334db2bb1a2fa1f15fff82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:53:49Z,use_quota=True,user_id='8c89badafb414440945ed1be34736973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e04bfea-757f-483a-86cc-e37bb7456115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e04bfea-757f-483a-86cc-e37bb7456115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fecc6e9c-5fc7-467e-94f0-daf472f8a30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fecc6e9c-5fc7-467e-94f0-daf472f8a30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5281f988-7d3c-457f-b719-2dac8c0c74b5', 'volume_name': 'volume-5281f988-7d3c-457f-b719-2dac8c0c74b5', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c6cff6-d207-49b8-b66a-d33d5c8f3544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c6cff6-d207-49b8-b66a-d33d5c8f3544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a00657-d190-498d-913a-33d2c730a7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:48 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Volume 5281f988-7d3c-457f-b719-2dac8c0c74b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5281f988-7d3c-457f-b719-2dac8c0c74b5', 'volume_size': 1} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698771853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5281f988-7d3c-457f-b719-2dac8c0c74b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fa0c1bdd334db2bb1a2fa1f15fff82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:53:49Z,use_quota=True,user_id='8c89badafb414440945ed1be34736973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Creating volume 5281f988-7d3c-457f-b719-2dac8c0c74b5 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:53:48 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:53:48 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5281f988-7d3c-457f-b719-2dac8c0c74b5 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:48 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5281f988-7d3c-457f-b719-2dac8c0c74b5 1073741824 Nov 06 18:53:48 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:49 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5281f988-7d3c-457f-b719-2dac8c0c74b5 1073741824" returned: 0 in 0.401s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5281f988-7d3c-457f-b719-2dac8c0c74b5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:49 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5281f988-7d3c-457f-b719-2dac8c0c74b5 Nov 06 18:53:49 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:49 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5281f988-7d3c-457f-b719-2dac8c0c74b5" returned: 0 in 0.237s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:49 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:53:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:49 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a00657-d190-498d-913a-33d2c730a7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5281f988-7d3c-457f-b719-2dac8c0c74b5', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:49 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c24860-6646-4a75-b3e5-a62f3183e0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:49 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Volume volume-5281f988-7d3c-457f-b719-2dac8c0c74b5 (5281f988-7d3c-457f-b719-2dac8c0c74b5): created successfully Nov 06 18:53:49 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c24860-6646-4a75-b3e5-a62f3183e0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:49 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Flow 'volume_create_manager' (65c947c4-f07b-4fa7-a2ee-f82ef3b4100d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:53:49 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-230e6a63-f371-46eb-b81b-81fc9c4ae6e5 tempest-ProjectReaderTests-2048621298 None] Created volume successfully. Nov 06 18:53:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-be8ea762-a385-49be-802f-fca5fb361845 tempest-ProjectReaderTests-2048621298 None] Acquiring lock "cinder-5281f988-7d3c-457f-b719-2dac8c0c74b5-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-be8ea762-a385-49be-802f-fca5fb361845 tempest-ProjectReaderTests-2048621298 None] Lock "cinder-5281f988-7d3c-457f-b719-2dac8c0c74b5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-be8ea762-a385-49be-802f-fca5fb361845 tempest-ProjectReaderTests-2048621298 None] Acquiring lock "cinder-quobyte-5281f988-7d3c-457f-b719-2dac8c0c74b5" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:49 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-be8ea762-a385-49be-802f-fca5fb361845 tempest-ProjectReaderTests-2048621298 None] Lock "cinder-quobyte-5281f988-7d3c-457f-b719-2dac8c0c74b5" acquired by "delete_volume" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:49 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6263ab4-d7f2-469a-9f64-899c9c92c141]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:49 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-be8ea762-a385-49be-802f-fca5fb361845 tempest-ProjectReaderTests-2048621298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5281f988-7d3c-457f-b719-2dac8c0c74b5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:50 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5281f988-7d3c-457f-b719-2dac8c0c74b5 Nov 06 18:53:50 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:50 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-be8ea762-a385-49be-802f-fca5fb361845 tempest-ProjectReaderTests-2048621298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5281f988-7d3c-457f-b719-2dac8c0c74b5" returned: 0 in 0.347s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-be8ea762-a385-49be-802f-fca5fb361845 tempest-ProjectReaderTests-2048621298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5281f988-7d3c-457f-b719-2dac8c0c74b5 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:50 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5281f988-7d3c-457f-b719-2dac8c0c74b5 Nov 06 18:53:50 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:50 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-be8ea762-a385-49be-802f-fca5fb361845 tempest-ProjectReaderTests-2048621298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-5281f988-7d3c-457f-b719-2dac8c0c74b5" returned: 0 in 0.244s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-be8ea762-a385-49be-802f-fca5fb361845 tempest-ProjectReaderTests-2048621298 None] Lock "cinder-quobyte-5281f988-7d3c-457f-b719-2dac8c0c74b5" released by "delete_volume" :: held 0.637s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:50 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-be8ea762-a385-49be-802f-fca5fb361845 tempest-ProjectReaderTests-2048621298 None] Created reservations ['96260942-35dc-4840-a8d6-1ed6d8a51f36', '330f58e0-9feb-4a63-88be-6b85c6cce882', '7a353439-1f5f-4237-8a4c-f9b7ddff6992', 'ff5aabdb-1e23-47e5-a82e-14997c885f3d'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:53:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-be8ea762-a385-49be-802f-fca5fb361845 tempest-ProjectReaderTests-2048621298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-be8ea762-a385-49be-802f-fca5fb361845 tempest-ProjectReaderTests-2048621298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:50 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-be8ea762-a385-49be-802f-fca5fb361845 tempest-ProjectReaderTests-2048621298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:50 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-be8ea762-a385-49be-802f-fca5fb361845 tempest-ProjectReaderTests-2048621298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-be8ea762-a385-49be-802f-fca5fb361845 tempest-ProjectReaderTests-2048621298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-be8ea762-a385-49be-802f-fca5fb361845 tempest-ProjectReaderTests-2048621298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:50 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:53:50 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:50 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:50 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-be8ea762-a385-49be-802f-fca5fb361845 tempest-ProjectReaderTests-2048621298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.240s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:50 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-be8ea762-a385-49be-802f-fca5fb361845 tempest-ProjectReaderTests-2048621298 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:53:50 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-be8ea762-a385-49be-802f-fca5fb361845 tempest-ProjectReaderTests-2048621298 None] Deleted volume successfully. Nov 06 18:53:50 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-be8ea762-a385-49be-802f-fca5fb361845 tempest-ProjectReaderTests-2048621298 None] Lock "cinder-5281f988-7d3c-457f-b719-2dac8c0c74b5-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Flow 'volume_create_manager' (dae3d20e-97fc-402d-b6c0-359391024120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5135593c-4d43-48ec-aeaf-25e48073ce50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5135593c-4d43-48ec-aeaf-25e48073ce50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1412981544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15deb4e-2380-47f6-9f4a-ac10f37adfd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fa0c1bdd334db2bb1a2fa1f15fff82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:53:51Z,use_quota=True,user_id='8c89badafb414440945ed1be34736973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abad3ffc-4930-49d1-abf0-d3e1bce0d038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abad3ffc-4930-49d1-abf0-d3e1bce0d038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce2640ea-3fb0-4493-8d7d-5943b8c6e473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce2640ea-3fb0-4493-8d7d-5943b8c6e473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a15deb4e-2380-47f6-9f4a-ac10f37adfd4', 'volume_name': 'volume-a15deb4e-2380-47f6-9f4a-ac10f37adfd4', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18561b4b-f3bb-48d2-9f94-138f918915c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18561b4b-f3bb-48d2-9f94-138f918915c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a896904-0b5b-4176-8716-278e4508aa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:51 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Volume a15deb4e-2380-47f6-9f4a-ac10f37adfd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a15deb4e-2380-47f6-9f4a-ac10f37adfd4', 'volume_size': 1} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1412981544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15deb4e-2380-47f6-9f4a-ac10f37adfd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fa0c1bdd334db2bb1a2fa1f15fff82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:53:51Z,use_quota=True,user_id='8c89badafb414440945ed1be34736973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Creating volume a15deb4e-2380-47f6-9f4a-ac10f37adfd4 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:53:51 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a15deb4e-2380-47f6-9f4a-ac10f37adfd4 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:51 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a15deb4e-2380-47f6-9f4a-ac10f37adfd4 1073741824 Nov 06 18:53:51 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:51 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:51 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a15deb4e-2380-47f6-9f4a-ac10f37adfd4 1073741824" returned: 0 in 0.410s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a15deb4e-2380-47f6-9f4a-ac10f37adfd4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:52 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a15deb4e-2380-47f6-9f4a-ac10f37adfd4 Nov 06 18:53:52 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:52 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a15deb4e-2380-47f6-9f4a-ac10f37adfd4" returned: 0 in 0.242s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:52 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:53:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a896904-0b5b-4176-8716-278e4508aa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a15deb4e-2380-47f6-9f4a-ac10f37adfd4', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86638cf1-548d-41df-a19a-e89d9ccd3a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:52 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Volume volume-a15deb4e-2380-47f6-9f4a-ac10f37adfd4 (a15deb4e-2380-47f6-9f4a-ac10f37adfd4): created successfully Nov 06 18:53:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86638cf1-548d-41df-a19a-e89d9ccd3a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:52 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Flow 'volume_create_manager' (dae3d20e-97fc-402d-b6c0-359391024120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:53:52 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-e00107bc-0ed5-4840-a453-e9fddef8b164 tempest-ProjectReaderTests-2048621298 None] Created volume successfully. Nov 06 18:53:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a49f3726-124d-49f5-9ff7-e19f5da9a8cc tempest-ProjectReaderTests-2048621298 None] Acquiring lock "cinder-a15deb4e-2380-47f6-9f4a-ac10f37adfd4-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a49f3726-124d-49f5-9ff7-e19f5da9a8cc tempest-ProjectReaderTests-2048621298 None] Lock "cinder-a15deb4e-2380-47f6-9f4a-ac10f37adfd4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a49f3726-124d-49f5-9ff7-e19f5da9a8cc tempest-ProjectReaderTests-2048621298 None] Acquiring lock "cinder-quobyte-a15deb4e-2380-47f6-9f4a-ac10f37adfd4" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:52 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a49f3726-124d-49f5-9ff7-e19f5da9a8cc tempest-ProjectReaderTests-2048621298 None] Lock "cinder-quobyte-a15deb4e-2380-47f6-9f4a-ac10f37adfd4" acquired by "delete_volume" :: waited 0.017s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:52 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc91b1b7-3464-4873-b100-3ef565933212]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a49f3726-124d-49f5-9ff7-e19f5da9a8cc tempest-ProjectReaderTests-2048621298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a15deb4e-2380-47f6-9f4a-ac10f37adfd4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:52 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a15deb4e-2380-47f6-9f4a-ac10f37adfd4 Nov 06 18:53:52 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:52 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a49f3726-124d-49f5-9ff7-e19f5da9a8cc tempest-ProjectReaderTests-2048621298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a15deb4e-2380-47f6-9f4a-ac10f37adfd4" returned: 0 in 0.350s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a49f3726-124d-49f5-9ff7-e19f5da9a8cc tempest-ProjectReaderTests-2048621298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a15deb4e-2380-47f6-9f4a-ac10f37adfd4 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:52 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a15deb4e-2380-47f6-9f4a-ac10f37adfd4 Nov 06 18:53:52 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:53 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a49f3726-124d-49f5-9ff7-e19f5da9a8cc tempest-ProjectReaderTests-2048621298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-a15deb4e-2380-47f6-9f4a-ac10f37adfd4" returned: 0 in 0.245s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:53 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a49f3726-124d-49f5-9ff7-e19f5da9a8cc tempest-ProjectReaderTests-2048621298 None] Lock "cinder-quobyte-a15deb4e-2380-47f6-9f4a-ac10f37adfd4" released by "delete_volume" :: held 0.637s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:53 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-a49f3726-124d-49f5-9ff7-e19f5da9a8cc tempest-ProjectReaderTests-2048621298 None] Created reservations ['e8876320-8af2-4abc-9ad5-4546320a1bc9', 'b4730040-1423-459c-9134-2996a5cedb2a', '9c392039-859e-4bf4-83f5-10abc262c421', 'ee3e0ac8-08b9-4f14-8b99-d0f38d16c38f'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:53:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a49f3726-124d-49f5-9ff7-e19f5da9a8cc tempest-ProjectReaderTests-2048621298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a49f3726-124d-49f5-9ff7-e19f5da9a8cc tempest-ProjectReaderTests-2048621298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a49f3726-124d-49f5-9ff7-e19f5da9a8cc tempest-ProjectReaderTests-2048621298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:53 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-a49f3726-124d-49f5-9ff7-e19f5da9a8cc tempest-ProjectReaderTests-2048621298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-a49f3726-124d-49f5-9ff7-e19f5da9a8cc tempest-ProjectReaderTests-2048621298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a49f3726-124d-49f5-9ff7-e19f5da9a8cc tempest-ProjectReaderTests-2048621298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:53 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:53:53 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:53 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:53 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-a49f3726-124d-49f5-9ff7-e19f5da9a8cc tempest-ProjectReaderTests-2048621298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.242s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:53 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-a49f3726-124d-49f5-9ff7-e19f5da9a8cc tempest-ProjectReaderTests-2048621298 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:53:53 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a49f3726-124d-49f5-9ff7-e19f5da9a8cc tempest-ProjectReaderTests-2048621298 None] Deleted volume successfully. Nov 06 18:53:53 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-a49f3726-124d-49f5-9ff7-e19f5da9a8cc tempest-ProjectReaderTests-2048621298 None] Lock "cinder-a15deb4e-2380-47f6-9f4a-ac10f37adfd4-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Flow 'volume_create_manager' (178e9a96-7da3-49e6-92df-ad5c663321cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83947905-84b0-4a5e-abf5-ac25e71307bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83947905-84b0-4a5e-abf5-ac25e71307bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698913521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2738a45-8db0-4c04-8900-3fe0cdf48439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fa0c1bdd334db2bb1a2fa1f15fff82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:53:54Z,use_quota=True,user_id='8c89badafb414440945ed1be34736973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56359f8-edd7-46d4-bce7-3f333d9d73fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56359f8-edd7-46d4-bce7-3f333d9d73fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c611e2cc-1bbe-4a5a-9cf9-57204cfb4929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c611e2cc-1bbe-4a5a-9cf9-57204cfb4929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2738a45-8db0-4c04-8900-3fe0cdf48439', 'volume_name': 'volume-c2738a45-8db0-4c04-8900-3fe0cdf48439', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf8c0d3-fc0f-430e-94f3-5e383c204201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf8c0d3-fc0f-430e-94f3-5e383c204201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e246c48-ebb6-43c7-9a71-ae7433ea798c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:54 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Volume c2738a45-8db0-4c04-8900-3fe0cdf48439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2738a45-8db0-4c04-8900-3fe0cdf48439', 'volume_size': 1} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698913521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2738a45-8db0-4c04-8900-3fe0cdf48439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fa0c1bdd334db2bb1a2fa1f15fff82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:53:54Z,use_quota=True,user_id='8c89badafb414440945ed1be34736973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Creating volume c2738a45-8db0-4c04-8900-3fe0cdf48439 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:53:54 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c2738a45-8db0-4c04-8900-3fe0cdf48439 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:54 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c2738a45-8db0-4c04-8900-3fe0cdf48439 1073741824 Nov 06 18:53:54 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:54 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c2738a45-8db0-4c04-8900-3fe0cdf48439 1073741824" returned: 0 in 0.413s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c2738a45-8db0-4c04-8900-3fe0cdf48439 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:54 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c2738a45-8db0-4c04-8900-3fe0cdf48439 Nov 06 18:53:54 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:54 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c2738a45-8db0-4c04-8900-3fe0cdf48439" returned: 0 in 0.237s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e246c48-ebb6-43c7-9a71-ae7433ea798c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2738a45-8db0-4c04-8900-3fe0cdf48439', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7466727-618c-4c9b-b244-461771c35ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:54 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Volume volume-c2738a45-8db0-4c04-8900-3fe0cdf48439 (c2738a45-8db0-4c04-8900-3fe0cdf48439): created successfully Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7466727-618c-4c9b-b244-461771c35ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Flow 'volume_create_manager' (178e9a96-7da3-49e6-92df-ad5c663321cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:53:54 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-97fcfac6-bf84-491b-ae44-c6326aa6d093 tempest-ProjectReaderTests-2048621298 None] Created volume successfully. Nov 06 18:53:55 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-08ae155d-64e3-469c-a9a7-0f663165d9ee tempest-ProjectReaderTests-2048621298 None] Acquiring lock "cinder-c2738a45-8db0-4c04-8900-3fe0cdf48439-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:55 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-08ae155d-64e3-469c-a9a7-0f663165d9ee tempest-ProjectReaderTests-2048621298 None] Lock "cinder-c2738a45-8db0-4c04-8900-3fe0cdf48439-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:55 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-08ae155d-64e3-469c-a9a7-0f663165d9ee tempest-ProjectReaderTests-2048621298 None] Acquiring lock "cinder-quobyte-c2738a45-8db0-4c04-8900-3fe0cdf48439" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:55 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-08ae155d-64e3-469c-a9a7-0f663165d9ee tempest-ProjectReaderTests-2048621298 None] Lock "cinder-quobyte-c2738a45-8db0-4c04-8900-3fe0cdf48439" acquired by "delete_volume" :: waited 0.015s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:55 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30d0840-c292-41c5-ac93-2cf23b6887a9]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-08ae155d-64e3-469c-a9a7-0f663165d9ee tempest-ProjectReaderTests-2048621298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c2738a45-8db0-4c04-8900-3fe0cdf48439 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:55 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c2738a45-8db0-4c04-8900-3fe0cdf48439 Nov 06 18:53:55 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:55 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-08ae155d-64e3-469c-a9a7-0f663165d9ee tempest-ProjectReaderTests-2048621298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c2738a45-8db0-4c04-8900-3fe0cdf48439" returned: 0 in 0.358s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-08ae155d-64e3-469c-a9a7-0f663165d9ee tempest-ProjectReaderTests-2048621298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c2738a45-8db0-4c04-8900-3fe0cdf48439 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:55 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c2738a45-8db0-4c04-8900-3fe0cdf48439 Nov 06 18:53:55 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:55 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-08ae155d-64e3-469c-a9a7-0f663165d9ee tempest-ProjectReaderTests-2048621298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-c2738a45-8db0-4c04-8900-3fe0cdf48439" returned: 0 in 0.240s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:55 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-08ae155d-64e3-469c-a9a7-0f663165d9ee tempest-ProjectReaderTests-2048621298 None] Lock "cinder-quobyte-c2738a45-8db0-4c04-8900-3fe0cdf48439" released by "delete_volume" :: held 0.638s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:55 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-08ae155d-64e3-469c-a9a7-0f663165d9ee tempest-ProjectReaderTests-2048621298 None] Created reservations ['84c7753d-5af5-46a9-9504-e7090a062ee3', 'b78160e4-5ca8-4747-b168-7b98db79f24d', '4dea0358-9135-47ee-9ba1-6b86908fbea7', 'd1eef4ca-59a5-4b6d-8864-dd8cd80e8fad'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:53:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-08ae155d-64e3-469c-a9a7-0f663165d9ee tempest-ProjectReaderTests-2048621298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-08ae155d-64e3-469c-a9a7-0f663165d9ee tempest-ProjectReaderTests-2048621298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:55 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-08ae155d-64e3-469c-a9a7-0f663165d9ee tempest-ProjectReaderTests-2048621298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:55 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-08ae155d-64e3-469c-a9a7-0f663165d9ee tempest-ProjectReaderTests-2048621298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-08ae155d-64e3-469c-a9a7-0f663165d9ee tempest-ProjectReaderTests-2048621298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:55 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-08ae155d-64e3-469c-a9a7-0f663165d9ee tempest-ProjectReaderTests-2048621298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:55 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:53:55 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:56 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-08ae155d-64e3-469c-a9a7-0f663165d9ee tempest-ProjectReaderTests-2048621298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.240s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-08ae155d-64e3-469c-a9a7-0f663165d9ee tempest-ProjectReaderTests-2048621298 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:53:56 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-08ae155d-64e3-469c-a9a7-0f663165d9ee tempest-ProjectReaderTests-2048621298 None] Deleted volume successfully. Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-08ae155d-64e3-469c-a9a7-0f663165d9ee tempest-ProjectReaderTests-2048621298 None] Lock "cinder-c2738a45-8db0-4c04-8900-3fe0cdf48439-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86794) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Flow 'volume_create_manager' (959ddc3d-f5b7-4bec-b1b9-40f318ca1d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0ea118-8062-45aa-be52-14c63657156f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0ea118-8062-45aa-be52-14c63657156f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1202442161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0a2714-8ac1-43bd-9f1e-afa1fa626969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fa0c1bdd334db2bb1a2fa1f15fff82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:53:57Z,use_quota=True,user_id='8c89badafb414440945ed1be34736973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318ba02f-8d04-4fd8-8642-ebd34795c1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318ba02f-8d04-4fd8-8642-ebd34795c1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c691f4-a9cf-41a7-b96c-c561b94e2326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c691f4-a9cf-41a7-b96c-c561b94e2326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c0a2714-8ac1-43bd-9f1e-afa1fa626969', 'volume_name': 'volume-6c0a2714-8ac1-43bd-9f1e-afa1fa626969', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de91713-0945-4bec-8a5e-841eb464a89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de91713-0945-4bec-8a5e-841eb464a89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405f806c-36b0-4a12-804b-0c7172307f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:56 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Volume 6c0a2714-8ac1-43bd-9f1e-afa1fa626969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c0a2714-8ac1-43bd-9f1e-afa1fa626969', 'volume_size': 1} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1202442161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0a2714-8ac1-43bd-9f1e-afa1fa626969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fa0c1bdd334db2bb1a2fa1f15fff82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:53:57Z,use_quota=True,user_id='8c89badafb414440945ed1be34736973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edcb84db-1279-46ab-b3a8-5816d1289e14),volume_type_id=edcb84db-1279-46ab-b3a8-5816d1289e14)}" {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.remotefs [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Creating volume 6c0a2714-8ac1-43bd-9f1e-afa1fa626969 {{(pid=86794) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Selected osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 as target Quobyte volume. {{(pid=86794) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:53:56 devstack cinder-volume[86794]: INFO cinder.volume.drivers.remotefs [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] casted to osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476 Nov 06 18:53:56 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6c0a2714-8ac1-43bd-9f1e-afa1fa626969 1073741824 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:56 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6c0a2714-8ac1-43bd-9f1e-afa1fa626969 1073741824 Nov 06 18:53:56 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:57 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6c0a2714-8ac1-43bd-9f1e-afa1fa626969 1073741824" returned: 0 in 0.395s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6c0a2714-8ac1-43bd-9f1e-afa1fa626969 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:57 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6c0a2714-8ac1-43bd-9f1e-afa1fa626969 Nov 06 18:53:57 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:57 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6c0a2714-8ac1-43bd-9f1e-afa1fa626969" returned: 0 in 0.238s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:57 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'} {{(pid=86794) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:53:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:57 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405f806c-36b0-4a12-804b-0c7172307f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c0a2714-8ac1-43bd-9f1e-afa1fa626969', 'volume_size': 1}' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:57 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44471bcd-e763-429b-9401-eda300c33c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:53:57 devstack cinder-volume[86794]: INFO cinder.volume.flows.manager.create_volume [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Volume volume-6c0a2714-8ac1-43bd-9f1e-afa1fa626969 (6c0a2714-8ac1-43bd-9f1e-afa1fa626969): created successfully Nov 06 18:53:57 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44471bcd-e763-429b-9401-eda300c33c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86794) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:53:57 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Flow 'volume_create_manager' (959ddc3d-f5b7-4bec-b1b9-40f318ca1d24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86794) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:53:57 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-8cce0871-f3ba-46de-ae14-1c93c5f61841 tempest-ProjectReaderTests-2048621298 None] Created volume successfully. Nov 06 18:53:57 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2f51a9f6-7f94-4f08-8d36-f2a91947096b tempest-ProjectReaderTests-2048621298 None] Acquiring lock "cinder-6c0a2714-8ac1-43bd-9f1e-afa1fa626969-delete_volume" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:57 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2f51a9f6-7f94-4f08-8d36-f2a91947096b tempest-ProjectReaderTests-2048621298 None] Lock "cinder-6c0a2714-8ac1-43bd-9f1e-afa1fa626969-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:57 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2f51a9f6-7f94-4f08-8d36-f2a91947096b tempest-ProjectReaderTests-2048621298 None] Acquiring lock "cinder-quobyte-6c0a2714-8ac1-43bd-9f1e-afa1fa626969" by "delete_volume" {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:53:57 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2f51a9f6-7f94-4f08-8d36-f2a91947096b tempest-ProjectReaderTests-2048621298 None] Lock "cinder-quobyte-6c0a2714-8ac1-43bd-9f1e-afa1fa626969" acquired by "delete_volume" :: waited 0.014s {{(pid=86794) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:53:57 devstack cinder-volume[86794]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f5462b-ff59-4635-9862-08baea30f925]: (4, 'qcow2') {{(pid=87821) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:53:57 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2f51a9f6-7f94-4f08-8d36-f2a91947096b tempest-ProjectReaderTests-2048621298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6c0a2714-8ac1-43bd-9f1e-afa1fa626969 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:57 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6c0a2714-8ac1-43bd-9f1e-afa1fa626969 Nov 06 18:53:57 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:58 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2f51a9f6-7f94-4f08-8d36-f2a91947096b tempest-ProjectReaderTests-2048621298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6c0a2714-8ac1-43bd-9f1e-afa1fa626969" returned: 0 in 0.359s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2f51a9f6-7f94-4f08-8d36-f2a91947096b tempest-ProjectReaderTests-2048621298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6c0a2714-8ac1-43bd-9f1e-afa1fa626969 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:58 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6c0a2714-8ac1-43bd-9f1e-afa1fa626969 Nov 06 18:53:58 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:58 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2f51a9f6-7f94-4f08-8d36-f2a91947096b tempest-ProjectReaderTests-2048621298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9/volume-6c0a2714-8ac1-43bd-9f1e-afa1fa626969" returned: 0 in 0.254s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:58 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2f51a9f6-7f94-4f08-8d36-f2a91947096b tempest-ProjectReaderTests-2048621298 None] Lock "cinder-quobyte-6c0a2714-8ac1-43bd-9f1e-afa1fa626969" released by "delete_volume" :: held 0.653s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:53:58 devstack cinder-volume[86794]: DEBUG cinder.quota [None req-2f51a9f6-7f94-4f08-8d36-f2a91947096b tempest-ProjectReaderTests-2048621298 None] Created reservations ['fbcf2a96-9fd5-40ba-ac86-2f5b4c176e3f', 'd516b180-3a13-4552-9219-9efcc1a4a047', 'bb862f76-969c-4f74-bf58-10e102d904ee', '3f6c0684-6ab4-42e3-930f-3a26a4650045'] {{(pid=86794) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:53:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2f51a9f6-7f94-4f08-8d36-f2a91947096b tempest-ProjectReaderTests-2048621298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:53:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2f51a9f6-7f94-4f08-8d36-f2a91947096b tempest-ProjectReaderTests-2048621298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:53:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2f51a9f6-7f94-4f08-8d36-f2a91947096b tempest-ProjectReaderTests-2048621298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476': None} {{(pid=86794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:53:58 devstack cinder-volume[86794]: DEBUG cinder.volume.drivers.quobyte [None req-2f51a9f6-7f94-4f08-8d36-f2a91947096b tempest-ProjectReaderTests-2048621298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b457d1b3-5f3b-414a-8401-a593a68e1476'] {{(pid=86794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:53:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [None req-2f51a9f6-7f94-4f08-8d36-f2a91947096b tempest-ProjectReaderTests-2048621298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:53:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2f51a9f6-7f94-4f08-8d36-f2a91947096b tempest-ProjectReaderTests-2048621298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:53:58 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9 Nov 06 18:53:58 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:53:58 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Nov 06 18:53:58 devstack cinder-volume[86794]: DEBUG oslo_concurrency.processutils [None req-2f51a9f6-7f94-4f08-8d36-f2a91947096b tempest-ProjectReaderTests-2048621298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c152bbcda1addc7bbaadda1687abe9" returned: 0 in 0.244s {{(pid=86794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:53:58 devstack cinder-volume[86794]: DEBUG cinder.manager [None req-2f51a9f6-7f94-4f08-8d36-f2a91947096b tempest-ProjectReaderTests-2048621298 None] Notifying Schedulers of capabilities ... {{(pid=86794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:53:58 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-2f51a9f6-7f94-4f08-8d36-f2a91947096b tempest-ProjectReaderTests-2048621298 None] Deleted volume successfully. Nov 06 18:53:58 devstack cinder-volume[86794]: DEBUG cinder.coordination [None req-2f51a9f6-7f94-4f08-8d36-f2a91947096b tempest-ProjectReaderTests-2048621298 None] Lock "cinder-6c0a2714-8ac1-43bd-9f1e-afa1fa626969-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=86794) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:54:08 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=99,cinder:INSERT=37,cinder:UPDATE=154,cinder:DELETE=11 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:54:08 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=114,cinder:INSERT=41,cinder:UPDATE=141,cinder:DELETE=13 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}